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(57) In order to the monochromatic conversion of an 
image, in an image processing apparatus (1a), the color 
used within the image inputted from an image inputting 
section (2) is determined by a color analyzing section 
(3), the mixing-ratio of the color components of the 
image is defined based on the color by a mixing-ratio 
calculating section (4), the color components are mixed 
according to the mixing-ratio by an image converting 
section (5) thereby converting the input image to a mon- 
ochromatic image, and it is outputted from an image 
outputting section (6). Further, in order to contract an 
composite image comprising a character, a line draw- 
ing, and a halftone dot, an image processing apparatus 
(21a) comprises an image inputting section (22), a char- 
acter/line drawing region extracting section (23) for an 
input image, a pseudo-density region extracting section 

(24) for the input image, an image contracting section 

(25) for contracting the image using different methods 
respectively in the pseudo-density region, the charac- 
ter/line drawing region, and the other region, and an 
image outputting section (26) for outputting the image. 
Furthermore, in order to eliminate a ghost image, in an 
image processing apparatus (31a), front and back 
images are inputted from an image inputting section 
(32), an image reversing section (33a) reverses it, a 
positional relationship detecting section (34) detects the 
positional relationship, an image correcting section (35) 
corrects the image as to eliminate a ghost image, an 



image reversing section (33b) reverses it again, and an 
image outputting section (36). Further, in order to align 
the image position, in an image processing apparatus 
(50), the alignment of the images of the consecutive 
pages from among the images inputted page by page 
from the image inputting section (51) is carried out by a 
page contour detecting section (52), a page contents 
region extracting section (53), an inclination correcting 
section (54), and page information processing section 
(57), and it is outputted from the image outputting sec- 
tion (56). 
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Description 

Technical Field 

5 [0001] The present invention relates to an image processing apparatus, an image processing method, and a 
medium on which an image processing program is recorded. Particularly, the invention relates to an image processing 
apparatus, an image processing method, and a medium on which an image processing program is recorded, each for 
converting, to a naturally monochromatic image, an image which is read by an image inputting means such as a scan- 
ner from an original printed in two colors, a color other than black, or the like. Further, the invention relates particularly 

10 to an image processing apparatus, an image processing method, and a medium on which an image processing pro- 
gram is recorded, each for contracting a composite image such as a cartoon comprising a character, a line drawing, and 
a halftone dot, with good precision and without a moire. Furthermore, the invention relates particularly to an image 
processing apparatus, an image processing method, and a medium on which an image processing program is 
recorded, each for performing the correction to eliminate a ghost image which occurs during the reading of an original 

15 printed on both sides or an original being stacked. Further, the invention relates particularly to an image processing 
apparatus, an image processing method, and a medium on which an image processing program is recorded, each for 
performing the aligning between desired pages in the image data of a book inputted in an authoring system for prepar- 
ing the contents of an electronic book by inputting the book on the image base. 

20 Background Art 

[0002] The progress in hardware and software has been activating the publication of electronic books as a new 
form of books in place of existing books on a paper medium. It has been realized to read cartoons and novels on a per- 
sonal computer or a portable terminal. 

25 [0003] Although these electronic books can be prepared correspondingly to what is called multimedia data, such 
as an audio, an image, a dynamic image, and an animation, it is costly and laborious to fabricate an electronic book as 
the primary object. Thus, an electronic book is fabricated frequently by directly computerizing an existing book. 
[0004] There are following problems in the fabrication of an electronic book in accordance with a conventional art. 
A first problem exists in the case of converting, to a naturally monochromatic image, an image read by an image input- 

30 ting means such as a scanner from a color-printed original or the like. 

[0005] The conversion from a color image to a monochromatic image is generally performed by extracting the 
brightness component from the color image. The following Formula (1) is a formula for extracting the brightness com- 
ponent (Y) from red (R), green (G), and blue (B) components. 

35 Y = 0.299R + 0.587G + 0.114B (1) 

[0006] This method is used also in the NTSC system which is a system for TV broadcasting, and is widely known. 
In the NTSC system, a color image is decomposed into a brightness signal and a color difference signal and then trans- 
mitted. Therefore, even a monochromatic television set can display a naturally monochromatic image on the television 
40 screen by receiving and reproducing the brightness signal alone. 

[0007] Formula (1 ) depends on the characteristics of human visual sensation, and a full-color image such as a pho- 
tograph can be converted to a naturally monochromatic image by converting the brightness component to the mono- 
chromatic image. 

[0008] Meanwhile, the contents of an electronic book computerized directly from an existing book can be viewed 
45 on a color display without any problem because of the unlimited number of display colors. However, a portable terminal 
frequently uses a monochromatic liquid-crystal display because of the important factors of a low price and a low power 
consumption. 

[0009] Accordingly, a full-color image such as a photograph is usually converted to a monochromatic image. Using 
Formula (1) to convert it to a naturally monochromatic image, monochromatic contents can be produced from an exist- 
50 ing book. Or, a color image can be displayed on a monochromatic display. 

[0010] However, in the case of a certain existing book, especially a cartoon journal, the image is sometimes printed 
in two colors with red ink and black ink or in a color with ink of a color selected from the group consisting of red, green, 
blue, and the like other than black. In that case, a desirable image quality is hardly obtained by converting such an 
image using Formula (1). 

55 [001 1] For example, in the case of an image printed in two colors with red ink and black ink, black is used for con- 
tours and shadows, and red is used for flesh color. When such an image is converted to a monochromatic image using 
Formula (1), the low mixing-ratio of red causes a problem that the red part becomes darker than the actual image. 
[0012] Further, an image is sometime printed in a single color other than black, such as red, green, and blue. When 
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people view such an image, the color itself is not explicitly recognized, and the resulted impression is similar to that of 
the image printed in a color of black. However, when such an image is converted to a monochromatic image using For- 
mula (1) in a similar manner to that for a photograph, the resulted image has a thin color and a low contrast. In partic- 
ular, an image printed with green ink results in an image with a very thin color because of the large mixing-ratio of green 
5 in Formula (1). 

[001 3] A second problem exists in the case of contracting a composite image such as a cartoon comprising a char- 
acter, a line drawing, and a halftone dot, with good precision and without a moire. 

[0014] Printed matter, such as a cartoon and a novel, is originally printed in a very high resolution, and a scanner 
for reading it also has a high resolution of 400 dpi (dot per inch), 600 dpi, or higher. In contrast, the display resolution of 
10 a personal computer or a portable terminal is at most about 100 dpi. Thus, the contraction of an image is necessary to 
display an existing book on a personal computer or a portable terminal. 

[0015] In many cartoons, a halftone screen is used for the pseudo-expression of density and gradation. Since the 
halftone screen comprises fine mesh dots, lines, and patterns, the contraction thereof, as known, ordinarily results in a 
pattern of stripes or lattice which is called a moire. In the invention, a region to which the pseudo-expression of density 

15 or gradation is imparted is called a pseudo-density region. 

[0016] Conventional art of contraction is classified into two major methods: a method in which the whole region is 
homogeneously processed and a method in which the region is divided and each of the divided regions is contracted 
optimally. The method in which the whole region is homogeneously processed generally includes a thinning-out proc- 
ess to achieve the contraction by simply thinning out the pixels and an averaging technique to determine the pixel value 

20 of the contracted image by averaging the pixel values of the original image (Hitoshi Kiya, Resolution Conversion of Dig- 
ital Image, CQ Publishing, The Interface, June 1998, p. 72). 

[0017] With regard to the region-dividing method, an image processing apparatus is described in Japanese Unex- 
amined Patent Publication JP-A 4-365182 (1992). In accordance with the image processing apparatus described in JP- 
A 4-3651 82, a binary coded image is divided into two regions, i.e., drawing and painting regions. In the drawing region, 
25 contraction is performed so as to conserve the fine lines. In the painting region, a multi-value encoding process is per- 
formed on the base of the pixel density, and then a contraction/binary-encoding process is performed, thereby to con- 
tract even the character and the drawing sections with precision and without a moire. 

[0018] However, in the case of contracting an image such as a cartoon comprising a character, a line drawing, and 
a halftone dot in combination, the thinning-out process causes a moire in the halftone section and unclearness and blur- 

30 ring in the character section and the line drawing section. In contrast, in the averaging technique, a moire is suppressed 
and the unclearness and blurring of a character and a fine line seldom occur, but the clearness of the whole is lost. To 
express the clearness, an edge enhancing process can be used after the contraction. However, the suppressed moire 
is also enhanced and appears. Although the moire can be completely eliminated by enlarging the area in which the pix- 
els are averaged, characters and drawings blur on the other hand. 

35 [0019] As mentioned above, prior art homogeneous processing by the thinning-out process or the averaging proc- 
ess cannot achieve clear characters and drawings without a moire. Thus, it is necessary to divide the image into regions 
and process each region appropriately. 

[0020] The image processing apparatus described in JP-A 4-365182 performs region-dividing and performs a con- 
traction process appropriate for each region. However, in a cartoon and the like, a line drawing may exist in halftone 

40 dots. Thus, a character and a line drawing cannot be separated by simple pattern matching. Further, a character exists 
in a balloon within the image. Thus, separation using a simple rectangle is difficult. In a method wherein an image is 
separated into two regions, i.e., a character/line drawing region and the other region, and wherein smoothing is per- 
formed in the region other than the character/line drawing region, an error frequently occurs in the extraction of the char- 
acter/line drawing region. For example, a rather blurring part in a fine line and a complicated character is sometimes not 

45 extracted as a character/line drawing region because of the low edge component. The process of smoothing of this 
region causes further blurring in the character and the line drawing section. 

[0021] A third problem exists in the case of performing the correction to eliminate a ghost image which occurs dur- 
ing the reading of an original printed on both sides or an original being stacked. 

[0022] Since an existing book is ordinarily printed on both sides of a paper, there is a problem of what is called a 
so ghost image, which is an image on the back side being seen through during the reading thereof with a scanner and the 
like or during the reading of a page being stacked with a scanner and the like. 

[0023] An image reader described in Japanese Unexamined Patent Publication JP-A 6-14185 (1994) is a prior art 
apparatus for correcting a ghost image. The image reader described in JP-A 6-14185 eliminates a ghost image part, 
which has a low density, by reducing the density through the density correction of the image signal, thereby preventing 
55 the copying of the seen-through image of the back side of an original or the next page of a stacked original. 

[0024] An image forming apparatus described in Japanese Unexamined Patent Publication JP-A 6-62216 (1994) is 
an apparatus for correcting a ghost image using front image data and back image data. The image forming apparatus 
described in JP-A 6-62216 performs an AND operation between the front image data and the back image data, per- 
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forms the smoothing of the output by a histogram calculation, and then performs a threshold process. Then the appa- 
ratus combines it with image data which is the front image data subtracted by the data of the superposed part, thereby 
eliminating the ghost image without the loss of the low density part of the front image. 

[0025] Further, an image processing apparatus with ghost-image eliminating function described in Japanese Unex- 
5 amined Patent Publication JP-A 8-340447 (1 996) eliminates a ghost image by detecting a ghost image region in a video 
signal and the ghost image level within the ghost image region and by correcting the density of the ghost image region 
using the ghost image level. 

[0026] However, since the image reader described in Japanese Unexamined Patent Publication JP-A 6-14185 
(1994) performs the density correction on the whole image, there occurs a problem that a halftone section whitens out 

10 and that a character becomes unclear. 

[0027] With regard to the image forming apparatus described in JP-A 6-62216, a ghost image cannot be completely 
eliminated in some cases, for example, in the case where a halftone section is seen through as a ghost image. Further, 
the positional relationship between the front image and the back image needs to be previously known, but the positions 
in which the images are read are not necessarily identical even if automatic paper feeding is used. Thus, a ghost image 

15 cannot be completely eliminated in such a case where the images are shifted from a predetermined position. 

[0028] In the image processing apparatus with ghost-image eliminating function described in JP-A 8-340447, a 
ghost image region is defined as a region in which non-character pixels are successive, a region in which non-painting 
pixels are successive, a region in which pixels having a density lower than or equal to a predetermined density are suc- 
cessive, and a region in which pixels having a saturation lower than or equal to a predetermined saturation are succes- 

20 sive. Accordingly, the determination is carried out in a small area. Therefore, a ghost image cannot be separated from 
a halftone image on the front side, for example, when the ghost image is caused by a widely spreading black dark region 
of characters or images. 

[0029] A fourth problem exists in the case of performing the aligning between desired pages in the image data of a 
book inputted in an authoring system for preparing the contents of an electronic book by inputting the book on the image 
25 base. 

[0030] Although an electronic book can be prepared correspondingly to what is called multimedia data, such as an 
audio, an image, a dynamic image, and an animation, it adopts a text (character-code) based format. Meanwhile, books 
on a paper medium, what is called "books" are presently being published at a pace of 500,000 or more titles a year. The 
accumulated number is huge. However, the number of the computerized titles is very few and almost all exist only on a 
30 paper medium. Such a prior art electronic book has the following problems because of adopting the text-(character- 
code) based format. 

[0031] For the authoring of a book on a paper medium, the text data needs to be prepared by human work or with 
an OCR. Thus, the preparation of the contents requires a lot of time, which causes a difficulty in the timely supply of 
contents in a large amount. Further, it is difficult to prepare the contents of a book such as a cartoon and a photographic 

35 journal, in which a majority of the data is non-text. For this reason, present number of the electronic book contents is as 
small as a few hundred, and many of the contents are dictionaries. Accordingly, the share of electronic books is pres- 
ently below 1% of that of paper books. In particular, the small number of the contents is a fatal problem, which is signif- 
icantly preventing the spread of electronic books. In such a situation, to resolve the above-mentioned problems, it is 
possible to obtain electronic book contents by inputting them on the image base. This has the following advantage. 

40 [0032] Contents preparation can be carried out basically only by scanning an existing book on a paper medium, 
which permits to supply a large amount of the contents in a short term. It permits to supply the contents of a cartoon, a 
photographic journal, and the like, which was impossible in a text-based electronic book. Inputting is easy even when a 
book, such as an old document, contains a character not in the present character code system, for example, an external 
character and a heteromorphic character. Overseas deployment (spreading) of a viewer and a total authoring system 

45 is easy because of the independence of a language (character code). By the advantage mentioned above, an electronic 
book on the image base resolves all problems in an electronic book on the text base. To obtain the electronic book con- 
tents by inputting it on the image base, it can be inputted by scanner inputting with an ADF (auto document feeder) and 
the like, and various processes such as document structuring are carried out on it. However, the following problems 
occur. 

so [0033] In the case where an image is inclined or shifted during the scanner inputting, an user of the electronic book 
feels uncomfortableness because the inclination is emphasized more than in the case of a paper book by a reference 
line (for example, an edge section of a CRT and a liquid-crystal screen) existing in a viewer. Thus, the process of cor- 
recting this is necessary. Manual processing of this needs a lot of working time, which causes a substantial increase in 
the authoring time. In particular, inclination and shift in a main page results in a strong uncomfortableness during the 

55 viewing on a viewer. Further, the checking of all pages for the revision of the electronic book contents causes an 
increase in the authoring time, which prevents to supply a large amount of contents in a short term. Thus, an appropri- 
ate process is necessary. 

[0034] A first object of the invention is to provide an image processing apparatus, an image processing method, and 
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a medium on which an image processing program is recorded, each for converting an original printed in two colors or 
a color other than black to a naturally monochromatic image. 

[0035] A second object of the invention is to provide an image processing apparatus, an image processing method, 
and a medium on which an image processing program is recorded, each for contracting a composite image such as a 

5 cartoon comprising a character, a line drawing, and a halftone dot, with clearness and without a moire. 

[0036] A third object of the invention is to provide an image processing apparatus, an image processing method, 
and a medium on which an image processing program is recorded, each for correcting an image to eliminate a ghost 
image which occurs during the reading of an original printed on both sides or an original being stacked. 
[0037] A fourth object of the invention is to provide an image processing apparatus, an image processing method, 

w and a medium on which an image processing program is recorded, each for obtaining aligned images. 

Disclosure of Invention 

[0038] A first invention is an image processing apparatus comprising: 

15 

image inputting means; 

color analyzing means for analyzing a color used within an input image; 

mixing-ratio calculating means for calculating a mixing-ratio of color components based on an analyzed color; and 
converting means for converting the input image to a monochromatic image by mixing color components according 
20 to a calculated mixing-ratio. 

[0039] In accordance with the invention, the data read from an original image is inputted from the image inputting 
means, for example, in every predetermined unit time. The color analyzing means analyzes the color used within the 
input image. Further, the mixing-ratio calculating means calculates the mixing-ratio of color components such as red, 
25 green and blue, based on the analyzed color. The mixing-ratio is determined so as to correspond to the color used 
within the input image. The converting means converts the input image to a monochromatic image by mixing color com- 
ponents according to the calculated mixing-ratio. 

[0040] Therefore, the color of the input image is automatically determined, whereby a monochromatic image can 
be produced. 

30 [0041] A second invention is characterized in that the image inputting means is capable of inputting a plurality of 
images; 

the color analyzing means analyzes colors used within the plurality of input images; 

the mixing-ratio calculating means calculates mixing-ratios of color components which are common to the plurality 
35 of images, based on analyzed colors; and 

the converting means converts the plurality of input images to monochromatic images by mixing color components 
according to calculated mixing-ratios. 

[0042] In accordance with the invention, the data read from the plurality of original images is inputted from the 
40 image inputting means, for example, in every predetermined unit time. The color analyzing means analyzes colors used 
within the plurality of input images. Further, the mixing-ratio calculating means calculates mixing-ratios of color compo- 
nents which are common to the plurality of images, based on the analyzed colors. That is, the mixing-ratios are deter- 
mined to correspond to the colors used within the plurality of input images. The converting means converts the plurality 
of input images to monochromatic images by mixing color components according to the calculated mixing-ratios. 
45 [0043] Therefore, the colors of the plurality of input images are automatically determined, whereby monochromatic 
images can be produced. Further, since color determination is carried out with respect to the plurality of input images, 
more accurate determination can be achieved. Furthermore, since monochromatic images are produced in the same 
conditions for the plurality of input images, the images can be produced stably. 
[0044] A third invention is an image processing apparatus comprising: 

50 

image inputting means; 

color specifying means for externally specifying a color used within an input image; 

mixing-ratio calculating means for calculating a mixing-ratio of color components based on a specified color; and 
converting means for converting the input image to a monochromatic image by mixing color components according 
55 to a calculated mixing-ratio. 

[0045] In accordance with the invention, the color specifying means specifies a color used within the image inputted 
from the image inputting means. Further, the mixing-ratio calculating means calculates the mixing-ratio of color compo- 
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nents based on the specified color That is, the mixing-ratio is determined so as to correspond to the color used within 
the input image. The converting means converts the input image to a monochromatic image by mixing color compo- 
nents according to the calculated mixing-ratio. 

[0046] Therefore, a monochromatic image with higher accuracy can be produced by specifying the color used 
5 within the input image by a user 

[0047] A fourth invention is an image processing apparatus comprising: 

image inputting means; 

mixing-ratio specifying means for externally specifying a mixing-ratio of color components; and 
w converting means for converting an input image to a monochromatic image by mixing color components according 
to a specified mixing-ratio. 

[0048] In accordance with the invention, the mixing-ratio specifying means specifies the mixing-ratio of color com- 
ponents for the image inputted from the image inputting means. The converting means converts the input image to a 
15 monochromatic image by mixing color components according to the specified mixing-ratio. 

[0049] Therefore, a desired monochromatic image can be produced by specifying the mixing-ratio of color compo- 
nents by a user 

[0050] A fifth invention is an image processing method comprising: 

20 a color analyzing step of analyzing a color used within an input image; 

a mixing-ratio calculating step of calculating a mixing-ratio of color components based on an analyzed color; and 
a converting step of converting the input image to a monochromatic image by mixing color components according 
to a calculated mixing-ratio. 

25 [0051] In accordance with the invention, an original image is read, for example, in every predetermined unit time, 
and the data is inputted. The color used within the image is analyzed. The mixing-ratio of color components is calcu- 
lated based on the analyzed color, whereby the mixing-ratio is determined so as to correspond to the color used within 
the input image. Further, the color components are mixed according to the calculated mixing- ratio, and the input image 
is converted to a monochromatic image. 

30 [0052] Therefore, the color of the input image is automatically determined, whereby a monochromatic image can 
be produced. 

[0053] A sixth invention is characterized in that in the color analyzing step color analysis is carried out based on 
distribution of hue, saturation and lightness of the input image. 

[0054] In accordance with the invention, analysis of the color used within the image is carried out, based on the dis- 
35 tribution of hue, saturation and lightness of the input image. For example, representative hue and dispersion are calcu- 
lated from the distribution of hue and saturation. Then, the presence or absence of black pixels is determined from the 
histogram of lightness. Analysis of the colors used within the input image is further carried out. That is, when represent- 
ative hue is absent, the image is determined as a monochromatic image. When the dispersion is greater than or equal 
to a predetermined value, the image is determined as an image in which plural colors are used. In the case where rep- 
40 resentative hue is absent and the dispersion is greater than or equal to a predetermined value, the image is determined 
as a monochromatic image in a color other than black when a black pixel is absent, and the image is determined as an 
image in black plus a color other than black when a black pixel is present. Further, the mixing-ratio of color components 
is calculated based on the analyzed colors, whereby the mixing-ratio is determined according to the colors used within 
the input image. Further, the color components are mixed according to the calculated mixing-ratio, and the input image 
45 is converted to a monochromatic image. 

[0055] Therefore, it is possible to produce a monochromatic image by automatically determining the color of the 
input image. 

[0056] A seventh invention is an image processing method comprising: 

so a color analyzing step of analyzing colors used within a plurality of input images; 

a mixing-ratio calculating step of calculating mixing-ratios of color components which are common to the plurality 
of input images, based on analyzed colors; and 

a converting step of converting the plurality of input images to monochromatic images by mixing color components 
according to calculated mixing-ratios. 

55 

[0057] In accordance with the invention, data is inputted, for example, by reading a plurality of original images in 
every predetermined unit time, colors used within the images are analyzed, and the mixing-ratios of color components 
which are common to the plurality of images are calculated according to the analyzed colors, whereby the mixing-ratios 
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are determined in correspondence to the colors used within the input images. Further, the color components are mixed 
according to the calculated mixing-ratios, and the plurality of input images are converted to monochromatic images. 
[0058] Therefore, the colors of the plurality of input images are automatically determined and monochromatic 
images can be produced. Further, since the colors are determined from the plurality of input images, the colors can be 
5 determined more accurately. Furthermore, since monochromatic images are produced in the same conditions for the 
plurality of input images, the images can be produced stably. 
[0059] An eighth invention is an image processing method comprising: 

a color specifying step of externally specifying a color used within an input image; 
10 a mixing-ratio calculating step of calculating a mixing-ratio of color components based on a specified color; and . 
a converting step of converting the input image to a monochromatic image by mixing color components according 
to a calculated mixing-ratio. 

[0060] In accordance with the invention, the color used within the input image is specified, the mixing-ratio of color 
15 components is calculated based on the color, the mixing-ratio is determined correspondingly to the color used within 
the input image, color components are mixed according to the calculated mixing-ratio, and the input image is converted 
to a monochromatic image. 

[0061] Therefore, a user can produce a monochromatic image with higher accuracy by specifying the color used 
within the input image. 

20 [0062] A ninth invention is characterized in that in the mixing-ratio calculating step a mixing-ratio is calculated 
based on a mixing-ratio table in which a mixing-ratio of color components corresponding to the color used within the 
input image is previously stored. 

[0063] In accordance with the invention, the color used within an input image is analyzed or specified. The mixing- 
ratio of color components is calculated based on the color used within the input image. The mixing-ratio is calculated 
25 by referring to the mixing-ratio table. Further, color components are mixed according to the calculated mixing-ratio, and 
the input image is converted to a monochromatic image. 

[0064] Therefore, it is possible to produce a monochromatic image by automatically determining the color of the 
input image. Further, by calculating the mixing-ratio with reference to the mixing-ratio table, an optimum mixing-ratio is 
rapidly obtained for each color used within the image. Thus, a more optimum monochromatic image can be produced 
30 at high speed. 

[0065] A tenth invention is characterized in that in the mixing-ratio calculating step the mixing-ratio is calculated 
based on a ratio of color components of a complimentary color of the color used within the input image. 
[0066] In accordance with the invention, the color used within an input image is analyzed or specified. The mixing- 
ratio of color components is calculated based on the color used within the input image. Here, the mixing-ratio is calcu- 
35 lated based on the color component ratio of a complimentary color of the color used within the input image. Further, the 
color components are mixed according to the calculated mixing-ratio, and the input image is converted to a monochro- 
matic image. 

[0067] Therefore, it is possible to produce a monochromatic image with high contrast by automatically determining 
the colors of the input image. 

40 [0068] An eleventh invention is characterized in that in the mixing-ratio calculating step the mixing-ratio is calcu- 
lated based on a color component ratio of a complimentary color of the color used within the input image and the color 
component ratio of the colors used within the input image. 

[0069] In accordance with the invention, the color used within an input image is analyzed or specified. The mixing- 
ratio of color components is calculated based on the color, and accordingly the mixing-ratio is determined correspond- 
45 ingly to the color used within the input image. The mixing-ratio is calculated based on the color component ratio of the 
complimentary color of the color used within the input image and the color component ratio of the color used within the 
input image. Further, the color components are mixed according to the calculated mixing-ratio, and the input image is 
converted to a monochromatic image. 

[0070] Therefore, the color of the input image is automatically determined, and a high-contrast monochromatic 
so image in which discrimination between the color used in the image and black is easily carried out can be produced. 
[0071] A twelfth invention is an image processing method comprising: 

a mixing-ratio specifying step of externally specifying a mixing-ratio of color components of an input image; and 
a converting step of converting the input image to a monochromatic image by mixing color components according 
55 to a specified mixing-ratio. 

[0072] In accordance with the invention, the mixing-ratio of color components of the input image is specified, and 
by mixing color components according to the mixing-ratio, the input image is converted to a monochromatic image. 
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[0073] Therefore, a desired monochromatic image can be produced by specifying the mixing-ratio of color compo- 
nents. 

[0074] A thirteenth invention is an medium on which an image processing program is recorded, the image process- 
ing program being for causing a computer to execute a color analyzing step of analyzing a color used within an input 
5 image; a mixing-ratio calculating step of calculating a mixing-ratio of color components based on a analyzed color; and 
a converting step of converting the input image to a monochromatic image by mixing color components according to a 
calculated mixing-ratio. 

[0075] In accordance with the invention, by following the image processing program recorded on the medium, a 
computer analyzes the color used within an input image, calculates the mixing-ratio of color components based on the 
10 color thereby to determine the mixing-ratio correspondingly to the color used within the input image, mixes the color 
components according to the mixing-ratio, and achieves the conversion from the input image to a monochromatic 
image. Therefore, the color of the input image is automatically determined and a monochromatic image can be pro- 
duced. 

[0076] A fourteenth invention is an medium on which an image processing program is recorded, the image process- 
es ing program being for causing a computer to execute a color analyzing step of analyzing colors used within a plurality 
of input images; a mixing-ratio calculating step of calculating mixing-ratios of color components which are common to 
the plurality of input images, based on analyzed colors; and a converting step of converting the plurality of input images 
to monochromatic images by mixing color components according to calculated mixing- ratios. 

[0077] In accordance with the invention, by following the image processing program recorded on the medium, a 
20 computer analyzes the color used within a plurality of input images, calculates the mixing-ratios of color components 
which are common to the plurality of input images, based on the colors, thereby to determine the mixing-ratios corre- 
spondingly to the colors used within the plurality of input images, mixes color components according to the mixing- 
ratios, and achieves the conversion from the plurality of input images to monochromatic images. Therefore, it is possible 
to produce monochromatic images by automatically determining the colors of the plurality of input images. 
25 [0078] A fifteenth invention is an medium on which an image processing program is recorded, the image processing 
program being for causing a computer to execute a color specifying step of externally specifying a color used within an 
input image; a mixing-ratio calculating step of calculating a mixing-ratio of color components based on a specified color; 
and a converting step of converting the input image to a monochromatic image by mixing color components according 
to a calculated mixing-ratio. 

30 [0079] In accordance with the invention, by following the image processing program recorded on the medium, a 
computer specifies a color used within an input image, calculates the mixing-ratio of color components based on the 
color thereby to determine the mixing-ratio correspondingly to the color used within the input image, mixes color com- 
ponents according to the mixing-ratio, and achieves the conversion from the input image to a monochromatic image. 
Therefore, it is possible to produce a monochromatic image with higher accuracy by specifying the color used within the 

35 input image by a user. 

[0080] A sixteenth invention is an medium on which an image processing program is recorded, the image process- 
ing program being for causing a computer to execute a mixing-ratio specifying step of externally specifying a mixing- 
ratio of color components of an input image; and a converting step of converting the input image to a monochromatic 
image by mixing color components according to a specified mixing-ratio. 
40 [0081] In accordance with the invention, by following the image processing program recorded on the medium, a 
computer specifies a mixing-ratio for an input image, mixes the color components according to the specified mixing- 
ratio, and achieves the conversion from the input image to a monochromatic image. Therefore, it is possible to produce 
a desired monochromatic image by specifying the mixing-ratio of color components by a user. 
[0082] A seventeenth invention is an image processing apparatus comprising: 

45 

image inputting means for inputting an image; 

character/line drawing region extracting means for extracting a character/line drawing region from the input image; 
pseudo-density region extracting means for extracting a pseudo-density region from the input image; 
image contracting means for contracting images in an extracted pseudo-density region, an extracted character/line 
so drawing region, and a region other than the pseudo-density region and the character/line drawing region, by mutu- 
ally different methods; and 

image outputting means for outputting the contracted image. 

[0083] In accordance with the invention, an image is inputted by the image inputting means, and from the image a 
55 character/line drawing region is extracted by the character/line drawing region extracting means and a pseudo-density 
region is extracted by the pseudo-density region extracting means. The image contracting means contracts the image 
using mutually different methods respectively in the pseudo-density region, the character/line drawing region, and the 
other region. The image outputting means outputs the contracted image. 
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[0084] Therefore, by dividing the input image into three regions, i.e., a pseudo-density region, a character/line draw- 
ing region and the other region, and by contracting the image in each region using a different method, the image can 
be contracted with a moire being suppressed in the pseudo-density region, the image can be clearly contracted in the 
character/line drawing region, and the image can be properly contracted in the other region. For example, even in the 
5 case where a moire occurs in the contraction of an image read and inputted at a predetermined resolution, the image 
read and inputted at a predetermined resolution can be clearly contracted without the occurrence of a moire in accord- 
ance with the invention. 

[0085] An eighteenth invention is characterized in that the image contracting means performs a smoothing process 
in the pseudo-density region, performs an averaging process and a subsequent edge enhancing process in the char- 
to acter/line drawing region, and performs an averaging process in a region other than the pseudo-density region and the 
character/line drawing region. 

[0086] In accordance with the invention, an image is inputted by the image inputting means, and from the image a 
character /line drawing region is extracted by the character/line drawing region extracting means and a pseudo-density 
region is extracted by the pseudo-density region extracting means. The image contracting means contracts the image 
15 using mutually different methods respectively in the pseudo-density region, the character/line drawing region and the 
other region. The image is contracted, by a smoothing process in the pseudo-density region, by an averaging process 
and a subsequent edge enhancing process in the character/line drawing region, and by an averaging process in the 
other region. The image outputting means outputs the contracted image. 

[0087] Therefore, the image can be contracted with a moire being suppressed in the pseudo-density region, the 
20 image can be clearly contracted in the character/line drawing region, and the image can be properly contracted in the 
other region. 

[0088] A nineteenth invention is characterized in that the character/line drawing region extracting means extracts a 
character/line drawing region from the input image before the extraction of a pseudo-density region. 
[0089] In accordance with the invention, an image is inputted by the image inputting means, and from the image the 
25 character/line drawing region extracting means extracts a character/line drawing region and thereafter the pseudo-den- 
sity region extracting means extracts a pseudo-density region. The image contracting means contracts the image using 
mutually different methods respectively in the pseudo-density region, the character/line drawing region and the other 
region. The image outputting means outputs the contracted image. 

[0090] Therefore, from the input image a character/line drawing region is firstly extracted and a pseudo-density 
30 region is then extracted. Therefore, the character/line drawing region can be accurately extracted without being affected 
from the pseudo-density region, even when it exists within the pseudo-density region. 

[0091] A twentieth invention is characterized in that the character/line drawing region extracting means extracts a 
character/line drawing region by performing an edge extraction of the input image after performing a smoothing process 
thereof. 

35 [0092] In accordance with the invention, an image is inputted by the image inputting means, and from the image the 
character/line drawing region extracting means extracts a character/line drawing region and thereafter the pseudo-den- 
sity region extracting means extracts a pseudo-density region. The character/line drawing region is extracted by the 
edge extraction of the input image after the smoothing process thereof. The image contracting means contracts the 
image using mutually different methods respectively in the pseudo-density region, the character/line drawing region and 

40 the other region. The image outputting means outputs the contracted image. 

[0093] Therefore, from the input image a character/line drawing region is firstly extracted as mentioned above and 
a pseudo-density region is then extracted. Therefore, the character/line drawing region can be accurately extracted 
without being affected from the pseudo-density region, even when it exists within the pseudo-density region. 
[0094] A twenty-first invention is characterized in that the pseudo-density region extracting means calculates a dis- 

45 persion of peripheral pixels around each pixel of the input image and extracts, as a pseudo-density region, the pixel 
which is one of pixels having a large dispersion and exists in a region which is not extracted as a character/line drawing 
region by the character/line drawing region extracting means. 

[0095] In accordance with the invention, an image is inputted from the image inputting means, and from the input 
image the character/line drawing region extracting means extracts a character/line drawing region and the pseudo-den- 

50 sity region extracting means extracts a pseudo-density region. From the input image the character/line drawing region 
is firstly extracted and thereafter the pseudo-density region is extracted. Further, the character/line drawing region is 
extracted by the predetermined technique described above. The pseudo-density region is extracted by calculating the 
dispersion of the peripheral pixels around each pixel of the input image and by extracting, as a pseudo-density region, 
the pixel which is one of the pixels having a large dispersion and exists in the region which is not extracted as a char- 

55 acter/line drawing region. The image contracting means contracts the image using mutually different methods respec- 
tively in the pseudo-density region, the character/line drawing region and the other region. The image outputting means 
outputs the contracted image. 

[0096] Therefore, by calculating the dispersion of peripheral pixels and by extracting, as a pseudo-density region, 
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the pixel is one of the pixels having a large dispersion and exists in the region which is not extracted as a character/line 
drawing region, the character/line drawing region is eliminated, whereby the pseudo-density region alone can be 
extracted accurately. 

[0097] A twenty-second invention is characterized in that the pseudo-density region extracting means calculates a 
5 correlation of peripheral pixels around each pixel of the input image and extracts, as a pseudo-density region, a pixel 
which is one of pixels having a low correlation and exists in the region which is not extracted as a character/line drawing 
region by the character/line drawing region extracting means. 

[0098] In accordance with the invention, an image is inputted from the image inputting means, and from the image 
the character/line drawing region extracting means extracts a character/line drawing region and the pseudo-density 

10 region extracting means extracts a pseudo-density region. From the input image the character/line drawing region is 
firstly extracted and thereafter the pseudo-density region is extracted. Further, the character/line drawing region is 
extracted by the predetermined technique described above. The pseudo-density region is extracted by calculating the 
correlation of the peripheral pixels around each pixel of the input image and by extracting, as a pseudo-density region, 
the pixel which is one of the pixels having a low con-elation and exists in the region which is not extracted as a charac- 

15 ter/line drawing region. The image contracting means contracts the image using mutually different methods respectively 
in the pseudo-density region, the character/line drawing region and the other region. The image outputting means out- 
puts the contracted image. 

[0099] Therefore, by calculating the correlation of peripheral pixels and by extracting, as a pseudo-density region, 
the pixel which is one of the pixels having a low correlation and exists in the region which is not extracted as a charac- 
20 ter/line drawing region, the character/line drawing region is eliminated more securely, whereby the pseudo-density 
region alone can be extracted accurately. 

[0100] A twenty-third invention is characterized in that the pseudo-density region extracting means detects an edge 
region of the input image and extracts, as a pseudo-density region, a region which is one of the extracted edge regions 
and is not extracted as a character/line drawing region by the character/line drawing region extracting means. 

25 [0101] In accordance with the invention, an image is inputted from the image inputting means, and from the image 
the character/line drawing region extracting means extracts a character/line drawing region and the pseudo-density 
region extracting means extracts a pseudo-density region. From the input image the character/line drawing region is 
firstly extracted from the input image and thereafter the pseudo-density region is extracted. Further, the character/line 
drawing region is extracted by the predetermined technique described above. Here, the pseudo-density region is 

30 extracted by detecting an edge region of the input image and by extracting, as a pseudo-density region, the region 
which is one of the edge regions and is not extracted as a character/line drawing region. The image contracting means 
contracts the image using mutually different methods respectively in the pseudo-density region, the character/line draw- 
ing region and the other region. The image outputting means outputs the contracted image. 
[0102] Therefore, the edge filter is simple, and the pseudo-density region can be extracted faster. 

35 [0103] A twenty-fourth invention is characterized in that contracting means performs edge detection of an extracted 
pseudo-density region and repeats the smoothing process for a region having a density greater than or equal to a pre- 
determined value. 

[0104] In accordance with the invention, an image is inputted from the image inputting means, and from the image 
the character/line drawing region extracting means extracts a character/line drawing region and the pseudo-density 

40 region extracting means extracts a pseudo-density region. The image contracting means contracts the image by the 
smoothing process in the pseudo-density region, contracts the image by the averaging process and a subsequent edge 
enhancing process in the character/line drawing region, and contracts the image by an averaging process in the other 
region. The edge detection is carried out in the pseudo-density region and the smoothing process is repeated for a 
region having a density greater than or equal to a predetermined value. The image outputting means outputs the con- 

45 tracted image. 

[0105] Therefore, occurrence of moire can be securely suppressed in the pseudo-density region and the image can 
be precisely contracted. 

[0106] A twenty-fifth invention is characterized in that the image contracting means performs edge detection of the 
extracted pseudo-density region and interrupts a contracting process for a region having a density greater than or equal 

50 to a predetermined value. 

[0107] In accordance with the invention, an image is inputted from the image inputting means, and from the image 
the character/line drawing region extracting means extracts a character/line drawing region and the pseudo-density 
region extracting means extracts a pseudo-density region. The image contracting means contracts the image using 
mutually different methods respectively in the pseudo-density region, the character/line drawing region and the other 

55 region. Here, the edge detection is performed for the pseudo-density region and for a region having a density greater 
than or equal to a predetermined value, the contracting process is interrupted. 

[0108] Therefore, the normal contracting process can be continued without an unnecessary contracting process. 
[0109] A twenty-sixth invention is an image processing method comprising: 
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an image inputting step; 

a character/line drawing region extracting step of extracting a character/line drawing region from an input image; 
a pseudo-density region extracting step of extracting a pseudo-density region from the input image; 
a image contracting step of contracting the image using mutually different methods respectively in the extracted 
5 pseudo-density region, the extracted character/line drawing region and the region other than the pseudo-density 
region and the character/line drawing region; and 
an image outputting step of outputting an contracted image. 

[0110J In accordance with the invention, an image is inputted, and from the image a character/line drawing region 
10 is extracted and a pseudo-density region is extracted. The image is contracted using mutually different methods respec- 
tively in the pseudo-density region, the character/line drawing region and the other region. The contracted image is then 
outputted. Therefore, the image can be contracted with a moire being suppressed in the pseudo-density region, the 
image can be clearly contracted in the character/line drawing region, and the image can be properly contracted in the 
other region. 

15 [01 11] A twenty-seventh invention is an medium recording an image processing program for causing a computer to 
execute an image inputting step; a character/line drawing region extracting step of extracting a character/line drawing 
region from an input image; a pseudo-density region extracting step of extracting a pseudo-density region from the input 
image; an image contracting step of contracting the image using mutually different methods respectively in the 
extracted pseudo-density region, the extracted character/line drawing region and the region other than the pseudo-den- 

20 sity region and the character/line drawing region; and an image outputting step of outputting a contracted image. 

[0112] In accordance with the invention, by following the image processing program recorded on the medium, a 
computer extracts a character/line drawing region from the image, extracts a pseudo-density region, contracts the 
image using mutually different methods respectively in the pseudo-density region, the character/line drawing region, 
and the other region, and outputs it. Therefore, the image can be contracted with a moire being suppressed in the 

25 pseudo-density region, the image can be clearly contracted in the character/line drawing region, and the image can be 
properly contracted in the other region. 

[0113] A twenty-eighth invention is an image processing apparatus comprising: 

image inputting means for inputting front and back images of an original; 
30 image reversing means for reversing one of the front and back images; 

positional relationship detecting means for detecting the positional relationship between the front image reversed 
by the image reversing means and the back image from the image inputting means or the positional relationship 
between the back image reversed by the image reversing means and the front image from the image inputting 
means; 

35 image correcting means for correcting the image to eliminate a ghost image of the image using the positional rela- 
tionship between the front and back images obtained from the positional relationship detecting means; and 
image outputting means for outputting the image. 

[01 14] In accordance with the invention, front and back images are inputted from the image inputting means. After 
40 one of the images is reversed by the image reversing means, the positional relationship between the front and back 
images is detected by the positional relationship detecting means. The image is corrected to be free from a ghost image 
by the image correcting means using the positional relationship, and then outputted by the image outputting means. 
Therefore, the input image can be outputted without a ghost image. 

[0115] A twenty-ninth invention is characterized in that the positional relationship detecting means detects the posi- 
45 tional relationship between the front and back images by extracting the high brightness component alone of the front 
and back images and by performing the block matching of the high brightness component. 

[0116] In accordance with the invention, front and back images are inputted from the image inputting means. After 
any one of the images is reversed by the image reversing means, the positional relationship between the front and back 
images is detected by the positional relationship detecting means. Here, the detection of the positional relationship 

so between the front and back images is carried out by extracting the high brightness component alone of the front and 
back images and by performing the block matching of the high brightness component The image is corrected to be free 
from a ghost image by the image correcting means using the positional relationship, and then outputted by the image 
outputting means. Accordingly, the positional relationship can be detected more precisely, and the input image can be 
outputted more securely without a ghost image. 

55 [01 1 7] A thirtieth invention is an image processing apparatus comprising: 

image inputting means; 

edge detecting means for detecting an edge of the image form the image inputting means; 
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image correcting means for correcting the image to eliminate a ghost image of the image by raising the brightness 
of high brightness pixels other than the edge of the image outputted from the edge detecting means; and 
image outputting means for outputting the image. 

5 [01 18] In accordance with the invention, the image inputting means inputs an image, and the edge detecting means 
detects an edge of the image. The image correcting means corrects the image to eliminate a ghost image of the image 
by raising the brightness of high brightness pixels other than the edge of the image outputted from the edge detecting 
means. The image outputting means outputs the image. Accordingly, the input image can be outputted with the unclear- 
ness of a character being prevented and without a ghost image. 

10 [0119] A thirty-first invention is an image processing apparatus comprising: 

image inputting means; 

edge detecting means for detecting an edge of the image form the image inputting means; 
image dividing means for dividing the image depending on the edge and low brightness pixels of the image output- 
15 ted from the edge detecting means; 

image correcting means for correcting the image to eliminate a ghost image of the image by calculating the average 
brightness within a region divided by the image dividing means and by raising the brightness of the high brightness 
region alone; and 

image outputting means for outputting the image. 

20 

[0120] In accordance with the invention, the image inputting means inputs an image, and the edge detecting means 
detects an edge of the image. The image dividing means divides the image based on the edge and low brightness pix- 
els of the image outputted from the edge detecting means. The image correcting means corrects the image to eliminate 
a ghost image of the image by calculating the average brightness within a divided region and by raising the brightness 

25 of the high brightness region alone. The image outputting means outputs the image. Accordingly, the input image can 
be outputted with the whitening-out of a halftone section being prevented and without a ghost image. 
[0121] A thirty-second invention is characterized in that the image correcting means acquires an representative 
brightness from the pixels having a brightness within a predetermined range, thereby raising the brightness of the 
region with referencing to the representative brightness. 

30 [0122] In accordance with the invention, the image inputting means inputs an image, and the edge detecting means 
detects an edge of the image. The image dividing means divides the image based on the edge and the low brightness 
pixel of the image outputted from the edge detecting means. The image correcting means corrects the image to elimi- 
nate a ghost image of the image by calculating the average brightness within a divided region and by raising the bright- 
ness of the high brightness region alone. Here, it acquires an representative brightness from the pixels having a 

35 brightness within a predetermined range, thereby raising the brightness of the region with referencing to the represent- 
ative brightness. The image outputting means outputs the corrected image. Accordingly, the input image can be output- 
ted without a ghost image, free from the influence of the difference in the transmittance depending on the paper quality. 
[0123] A thirty-third invention is an image processing method comprising: 

40 an image reversing step of reversing one of front and back images of an original; 

a positional relationship detecting step of detecting a positional relationship between the reversed one and the 
other of the front and back images; and 

an image correcting step of correcting the other one to eliminate a ghost image of the reversed one using a result 
of the positional relationship detection. 

45 

[0124] In accordance with the invention, front and back images are inputted, and after one of the images is 
reversed, the positional relationship between the reversed one and the other one of the front and back images is 
detected, the other one is corrected to be free from a ghost image of the reversed one using the positional relationship, 
and then outputted. Accordingly, the input image can be outputted without a ghost image. 
so [0125] A thirty-fourth invention is an image processing method comprising: 

an image-edge detecting step of detecting an edge of an image; and 

an image correcting step of correcting the image to eliminate a ghost image from the image by raising the bright- 
ness of high brightness pixels other than a detected edge. 

55 

[0126] In accordance with the invention, an image is inputted, an edge of the image is detected to correct the image 
to be free from a ghost image in the image by raising the brightness of high brightness pixels other than the edge of the 
image outputted from the edge detection and output the resulting image. Accordingly, it is possible to output the input 
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image without unclearness of characters and a ghost image. 

[0127] A thirty-fifth invention is an image processing method comprising: 

an image-edge detecting step of detecting an edge of an image; 
5 an image dividing step of dividing the image based on a detected edge and low brightness pixels; and 

an image correcting step of correcting the image to eliminate a ghost image from the image by calculating an aver- 
age brightness within a divided region and by raising a brightness of the high brightness region alone. 

[0128] In accordance with the invention, an image is inputted, an edge of the image is detected, the image is 
10 divided based on the edge and the low brightness pixels of the image outputted from the edge detection, and the image 
is corrected to be free from a ghost image by calculating the average brightness within a divided region and by raising 
the brightness of the high brightness region alone, and then outputted. Accordingly, it is possible to output the input 
image without whitening-out of a halftone section and a ghost image. 

[0129] A thirty-sixth invention is an medium on which an image processing program is recorded, the image 
15 processing program being for causing a computer to execute an image reversing step of reversing one of front and back 
images; a positional relationship detecting step of detecting a positional relationship between the reversed one and the 
other of the front and back images; and an image correcting step of correcting the image to eliminate a ghost image 
from the other using a result of the positional relationship detection. 

[0130] In accordance with the invention, by following the image processing program recorded on the medium, a 
20 computer reverses one of inputted front and back images, thereafter, detects the positional relationship between the 
reversed one and the other of the front and back images, corrects the image to eliminate a ghost image from the other 
image using the positional relationship, and outputs a resulting image. Accordingly, the input image can be outputted 
without a ghost image. 

[0131] A thirty-seventh invention is an medium on which an image processing program is recorded, the image 
25 processing program being for causing a computer to execute an image-edge detecting step of detecting an edge of an 
image; and an image correcting step of correcting the image to eliminate a ghost image of the image by raising a bright- 
ness of a high brightness pixel other than the detected edge. 

[0132] In accordance with the invention, by following the image processing program recorded on the medium, a 
computer detects an edge of an inputted image, corrects the image to eliminate a ghost image from the image by rais- 
30 ing the brightness of a high brightness pixel other than the edge of the image outputted from the edge detection, and 
outputs a resulting image. Accordingly, the input image can be outputted without unclearness of characters and a ghost 
image. 

[0133] A thirty-eighth invention is an medium on which an image processing program is recorded, the image 
processing program being for causing a computer to execute an image-edge detecting step of detecting an edge of an 
35 image; an image dividing step of dividing the image based on a detected edge and low brightness pixels; and an image 
correcting step of correcting the image to eliminate a ghost image from the image by calculating an average brightness 
within a divided region and by raising a brightness of a high brightness region alone. 

[0134] In accordance with the invention, by following the image processing program recorded on the medium, a 
computer detects an edge of an inputted image, divides the image based on the edge and the low brightness pixels of 
40 the image outputted from the edge detection, corrects the image to eliminate a ghost image from the image by calcu- 
lating the average brightness within a divided region and by raising the brightness of the high brightness region alone, 
and outputs a resulting image. Accordingly, it is possible to output the input image without a ghost image with the whit- 
ening-out of a halftone section being prevented. 

[0135] A thirty-ninth invention is an image processing apparatus comprising: 

45 

image inputting means for inputting an image page by page; 

image determining means for determining a predetermined image from among inputted images; 
template acquiring means for acquiring a template used as an alignment reference from an image which is deter- 
mined as the predetermined image; and 
so image correcting means for correcting a position between the images based on the template, thereby aligning 
images of consecutive pages. 

[01 36] In accordance with the invention, the image inputting means inputs an image page by page, the image deter- 
mining means determines a predetermined image from among the images, the template acquiring means acquires a 
55 template from the determined image, and the image correcting means corrects the position between the images based 
on the template, whereby the images of consecutive pages are aligned. 

[0137] Accordingly, the alignment between desired consecutive images from among the images inputted page by 
page can be carried out in a short time. 
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[0138] A fortieth invention is an image processing apparatus comprising: 
image inputting means for inputting an image page by page of a book; 

image determining means for determining a predetermined main-text image from among inputted images; 
5 template acquiring means for acquiring a template used as an alignment reference from an image which is deter- 
mined as the predetermined main-text image; and 

image correcting means for correcting a position between the main-text images based on the template, thereby 
aligning the main-text images of consecutive pages. 

10 [0139] In accordance with the invention, the image inputting means inputs an image page by page of a book, the 
image determining means determines a predetermined main-text image from among the images, the template acquir- 
ing means acquires a template from the determined image, and the image correcting means corrects the position 
between main-text images based on the template, whereby the main-text images of consecutive pages are aligned. 
[0140] Accordingly, the alignment between main-text images from among the main-text images inputted page by 

15 page can be carried out in a short time. Thus, the contents of an electronic book can be prepared in a short term. Fur- 
ther, since the position of the main-text images is aligned when the electronic book is viewed in a viewer, uncomforta- 
bleness to a user can be eliminated. 

[0141] A forty-first invention is an image processing method comprising: 

20 an image determining step of determining a predetermined image from among images inputted page by page; 

a template acquiring step of acquiring a template used as an alignment reference from an image which is deter- 
mined as the predetermined image; and 

an image correcting means for correcting a position between the images based on the template, thereby aligning 
images of consecutive pages. 

25 

[0142] In accordance with the invention, a predetermined image is determined from among the images inputted 
page by page. A template is acquired from the determined image. The position between the images is corrected based 
on the template, thereby aligning the images of consecutive pages. Accordingly, the alignment between desired con- 
secutive images from among the images inputted page by page can be carried out in a short time. 
30 [0143] A forty-second invention is characterized in that the template acquiring step is a step of acquiring, as a tem- 
plate, positional information of a rectangle defined by circumscribing lines obtained from an ensemble of edge points 
acquired by scanning the input image. 

[0144] In accordance with the invention, a predetermined image is determined from among the images inputted 
page by page, and a template is acquired from the determined image. Here, the template is acquired as the positional 
35 information of the rectangle defined by the circumscribing lines obtained from the ensemble of the edge points acquired 
by spanning the input image. The position between the images is corrected based on the template, thereby aligning the 
images of consecutive pages. Accordingly, since the template is acquired using the circumscribing lines, an accurate 
template can be obtained, thereby improving the precision of the alignment. 

[0145] A forty-third invention is characterized in that the image processing method further comprises a step of gen- 
40 erating warning data in the case where the predetermined image is determined from among input images during the 
image determining step and that positional information of the input image and positional information of the template are 
out of a predetermined range. 

[0146] In accordance with the invention, a predetermined image is determined from among the images inputted 
page by page, and a template is acquired from the determined image, as described above. The position between the 
45 images is corrected based on the template, thereby aligning the images of consecutive pages. Warning data is gener- 
ated in the case where the predetermined image is determined from among the input images and the positional infor- 
mation of the input image and the positional information of the template are out of a predetermined range. Accordingly, 
failure in the alignment between the images can be detected, and hence, there is convenience in revision during or after 
the authoring. 

so [0147] A forty-fourth invention is an image processing method comprising: 

an image determining step of determining a predetermined main-text image from among images inputted page by 
page of a book; 

a template acquiring step of acquiring a template used as an alignment reference from an image which is deter- 
55 mined as the predetermined main-text image; and 

an image correcting step of correcting a position between the main-text images based on the template, thereby 
aligning main-text images of consecutive pages. 
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[0148] In accordance with the invention, a predetermined main-text image is determined from among the images 
inputted page by page of a book. A template is acquired from the determined image. The position between main-text 
images is corrected based on the template, thereby aligning the main-text images of consecutive pages. 
[0149] Accordingly, the alignment between main-text images from among the main-text images inputted page by 
5 page can be carried out in a short time. Thus, the contents of an electronic book can be prepared in a short term. Fur- 
ther, since the position of the main-text images is aligned when the electronic book is viewed in a viewer, uncomforta- 
Neness to a user can be eliminated. 

[0150] A forty-fifth invention is an medium on which an image processing program is recorded, the image process- 
ing program being for causing a computer to execute an image determining step of deter mining a predetermined image 

w from among images inputted page by page; a template acquiring step of acquiring a template used as an alignment ref- 
erence from an image which is determined as the predetermined image; and image correcting means for correcting a 
position between images based on the template, thereby aligning images of consecutive pages. 
[0151] In accordance with the invention, by following the image processing program recorded on the medium, a 
computer determines a predetermined image from among the images inputted page by page, acquires a template from 

15 the determined image, and corrects the position between the images based on the template, thereby aligning the 
images of consecutive pages. Accordingly, the alignment between desired consecutive images from among the images 
inputted page by page can be carried out in a short time. 

[0152] A forty-sixth invention is an medium on which an image processing program is recorded, the image process- 
ing program being for causing a computer to execute an image determining step of determining a predetermined main- 
20 text image from among images inputted page by page of a book; template acquiring step of acquiring a template used 
as an alignment reference from an image which is determined as the predetermined main-text image; and image cor- 
recting step of correcting a position between the main-text images based on the template, thereby aligning main-text 
images of consecutive pages. 

[0153] In accordance with the invention, by following the image processing program recorded on the medium, a 
25 computer determines a predetermined main-text image from among the images inputted page by page of a book, 
acquires a template from the determined image, and corrects the position between main- text images based on the tem- 
plate, thereby aligning the main-text images of consecutive pages. Accordingly, the alignment between main-text 
images from among the main-text images inputted page by page can be carried out in a short time. Thus, the contents 
of an electronic book can be prepared in a short term. Further, since the position of the main-text images is aligned 
30 when the electronic book is viewed in a viewer, uncomfortableness to a user can be eliminated. 

Brief Description of Drawings 

[0154] Other and further objects, features, and advantages of the invention will be more explicit from the following 
35 detailed description taken with reference to the drawings wherein: 

Fig. 1 is a block diagram of an image processing apparatus 1a in accordance with a first embodiment of the inven- 
tion. 

Fig. 2 is a flow chart showing the image processing method of the image processing apparatus 1a. 
40 Fig. 3 is a flow chart for describing a color analyzing section 3. 
Fig. 4 is a graph for describing a step S22. 
Fig. 5 is a graph for describing a step S23. 
Fig. 6 is a graph for describing a step S24. 

Fig. 7 is a block diagram of an image processing apparatus 1b in accordance with a second embodiment of the 
45 invention. 

Fig. 8 is a flow chart showing the image processing method of the image processing apparatus 1b. 
Fig. 9 is a block diagram of an image processing apparatus 1c in accordance with a third embodiment of the inven- 
tion. 

Fig. 10 is a flow chart showing the image processing method of the image processing apparatus 1c. 
so Fig. 1 1 is a block diagram of an image processing apparatus 21a in accordance with a fourth embodiment of the 
invention. 

Fig. 12 is a diagram for describing the area in which the dispersion is calculated for a pixel of interest. 
Fig. 13 is a diagram for describing a contracting process by averaging. 
Fig. 14 is a diagram for describing a contracting process by smoothing. 
55 Fig. 15 is a block diagram of an image processing apparatus 21b in accordance with a fifth embodiment of the 
invention. 

Fig. 16 is a diagram for describing the method of calculating the correlation of peripheral pixels. 

Fig. 17 is a flow chart showing the image processing method of the image processing apparatus in accordance with 
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the seventeenth to the twenty-third inventions. 

Fig. 18 is a flow chart showing the image processing method of the image processing apparatus in accordance with 
the twenty-fourth invention. 

Fig. 19 is a flow chart showing the image processing method of the image processing apparatus in accordance with 
5 the twenty-fifth invention. 

Fig. 20 is a block diagram of an image processing apparatus 31a in accordance with a seventh embodiment of the 
invention. 

Fig. 21 is a diagram for describing a positional relationship detecting section 34. 
Fig. 22 is a graph for describing the mean for extracting a high brightness component. 
w Fig. 23 is a block diagram of an image processing apparatus 31b in accordance with an eighth embodiment of the 
invention. 

Fig. 24 is a graph for describing the operation of an image correcting section 38. 

Fig. 25 is a block diagram of an image processing apparatus 31c in accordance with a ninth embodiment of the 
invention. 

15 Fig. 26 is a diagram for describing the operation of an image dividing section 39. 
Fig. 27 is a graph for describing the method of calculating a pixel value t2. 

Fig. 28 is a block diagram of an image processing apparatus 50 in accordance with a tenth embodiment of the 
invention. 

Fig. 29 is a schematic diagram showing the configuration of a book inputted to the image processing apparatus 50. 
20 Fig. 30 is a diagram for describing the page-contour detecting operation of a page-contour detecting section 52. 

Fig. 31 is a flow chart for describing the page-contour detecting technique of the page-contour detecting section 52. 
Fig. 32 is a diagram for describing the page-contents region extracting operation of a page-contents region extract- 
ing section 53. 

Fig. 33 is a flow chart for describing the page-contents region extracting technique of the page-contents region 
25 extracting section 53. 

Fig. 34 is a diagram showing the situation of an image rotation. 

Fig. 35 is a diagram showing the form of a template stored in a page positional information buffer 60. 
Best Mode for Carrying Out the Invention 

30 

[0155] Now referring to the drawings, preferred embodiments of the invention are described below. 
(First Embodiment) 

35 [0156] Fig. 1 is a block diagram of an image processing apparatus 1 a in accordance with a first embodiment of the 
invention. The image processing apparatus 1a comprises an image inputting section 2, a color analyzing section 3, a 
mixing-ratio calculating section 4, an image converting section 5, and an image outputting section 6. The image input- 
ting section 2 reads an original image, for example, an image of a cartoon journal, in a predetermined unit, such as a 
spread and a page, and inputs it to the color analyzing section 3. The color analyzing section 3 analyzes the color used 

40 in the input image. The mixing-ratio calculating section 4 determines the mixing-ratio r:g:b of the respective color com- 
ponents of red (R), green (G), and blue (B). The image converting section 5 mixes the color components of R, G and B 
based on the determined mixing-ratio, thereby converting the input image into a monochromatic image. The image out- 
putting section 6 outputs the converted image. 

[0157] The image inputting section 2 is implemented by an image reading apparatus, such as a scanner, a copying 
45 machine, and a camera. It may also be implemented by an apparatus for reading an image from an medium, such as a 
CD-ROM (compact disk-read only memory), a hard disk, a floppy disk and a magneto-optical disk, which contains an 
image previously read from an original, as well as by a semiconductor memory. 

[0158] The image outputting section 6 is implemented by an image displaying apparatus, such as a CRT (cathode 
ray tube) and an LCD (liquid crystal display). It may also be an image printing apparatus such as a printer. Further, it 
so may also be implemented by an apparatus for writing out an image on an medium, such as a CD-ROM, a hard disk, a 
floppy disk and a magneto-optical disk, as well as by a semiconductor memory. 

[0159] The color analyzing section 3, the mixing-ratio calculating section 4 and the image converting section 5 are 
implemented, for example, by a computer and a software. 

[0160] Fig. 2 is a flow chart showing the image processing method of the image processing apparatus 1a. The 
55 image inputting section 2 inputs an original image in a predetermined unit (S1). The color analyzing section 3 analyzes 
the color used in the input image (S2). The mixing-ratio calculating section 4 determines the mixing-ratio r:g:b of the 
respective color components of R, G and B (S3). The image converting section 5 mixes the color components of R, G 
and B according to the mixing-ratio, thereby converting the input image to a monochromatic image (S4). The image out- 
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putting section 6 outputs the converted image (S5). 

[0161] Fig. 3 is a flow chart for describing the color analyzing section 3. The color analyzing section 3 converts the 
input image in a predetermined unit into hue (H), saturation (S) and lightness (L) (S21). The conversion of the input 
image into H, S and L can be carried out by a well known method (description is omitted). Then, the representative hue 

5 and the dispersion are obtained from the distribution of H and S (S22). Then, the presence or absence of a black pixel 
is determined from the histogram of L (S23), thereby determining the color used in the image (S24). 
[0162] Fig. 4 is a graph for describing the step S22. Fig. 4(a) is a graph having a horizontal axis indicating hue (H) 
and a vertical axis indicating the sum of saturation (S). The sum of S is defined by the sum of the values of S of all the 
pixels having an identical value of H. It is shown as a histogram weighted by S in order to obtain the color used in the 

10 image. Selecting the H giving the maximum of the sum of S, let it be the representative hue HO. When the sum of S at 
HO is less than or equal to a predetermined value, the input image is determined as an originally monochromatic image, 
and the representative hue HO is determined as absent. 

[0163] Using the relation H±2rc = H , the sum of S is transformed so that the sum of S distributes in a range of 
H0±2jc, thereby obtaining the dispersion V. When the dispersion V is greater than or equal to a predetermined value, it 
15 is determined that a plurality of colors are used in the input image. Otherwise, it is determined that the representative 
hue HO alone is used. 

[0164] Fig. 5 is a graph for describing the step S23. When a histogram of lightness (L) is prepared in 256 steps, 
black not being used decreases the low lightness pixels as shown in Fig. 5(a), and black being used increases the low 
lightness pixels as shown in Fig. 5(b). Accordingly, whether black is used or not can be determined depending on 

20 whether the distribution of the pixels in a low lightness range is within a predetermined range or not. 

[0165] Fig. 6 is a graph for describing the step S24. When the representative hue HO is absent, the input image is 
determined as a monochromatic image (S241). When the dispersion V obtained in the step S22 is greater than or equal 
to a predetermined value, it is determined that a plurality of colors are used in the input image (S242). Otherwise, the 
input image is determine as a monochromatic image in a color other than black if a black pixel is absent, and the input 

25 image is determine as an image in black plus another one color if a black pixel is present (S243). 

[0166] Using the representative hue HO, the color used in the image is determined as follows. First, determine 
which of 0, tc/3, 2rc/3, it, 4tc/3, 5jc/3 and 2n is the closest to HO. Here, HO is assumed to be within the range of 0-2it. It is 
respectively determined as red (R) for 0 and 2k, yellow (Y) for rc/3, green (G) for 2rc/3, cyan (C) for n, blue (B) for 4rc/3 
and magenta (M) for 5rc/3. 

30 [0167] The mixing-ratio calculating section 4 is described below. The mixing-ratio calculating section 4 determines 
the mixing-ratio r:g:b of the R, G and B components based on the analysis result of the color analyzing section 3. That 
is, it changes the mixing-ratio correspondingly to the color used in the image. 

[0168] When the color analyzing section 3 determines as a monochromatic image, r=0, g=1 and b=0 are used, for 
example. In a monochromatic image, there is no difference in R, G and B components, and hence, any of the r, g and 
35 b may be unity. Further, all of them may be an identical value. 

[0169] When the color analyzing section 3 determines as plural colors, r=0.299, g=0.587 and b=0.114 are used 
similarly in an ordinary color/monochromatic conversion. Using such a mixing-ratio, a full-color image such as a photo- 
graphic image can be converted to a naturally monochromatic image. 

[0170] When the color analyzing section 3 determines as a single color other than black, the mixing-ratio is 

40 assigned by the ratio of the color components of the complimentary color of the color used in the image which is 
obtained and inputted by the color analyzing section 3. Here, the complimentary color is the color which becomes white 
when mixed with that color. For example, when the color used in the input image is red (R), its complimentary color is 
cyan (C). Since the ratio of the R, G and B components of cyan is 0:1:1, required mixing-ratio becomes r=0, g=0.5 and 
b=0.5. By mixing the R, G and B in such a mixing-ratio, the conversion to a monochromatic image is achieved with the 

45 highest contrast of the image. 

[0171] When the color analyzing section 3 determines as black plus one color other than black, the mixing-ratio is 
assigned by the ratio of the color components of the complimentary color of the color used in the image obtained by the 
color analyzing section 3, with adjustment by the ratio of the color components used in the image. For example, when 
the colors used in the input image are red (R) and black, the ratio of the color components of red (R) is 1 :0:0, and the 

50 ratio of the R, G and B components of cyan (C) which is the complimentary color of red is 0:1 :1 . In order to set the red 
between black and white for the distinction between red and black, the ration of red is reduced to the half of the ratio of 
cyan, and added. Therefore, required mixing-ratio r:g:b becomes r=0.2, g=0.4 and b=0.4. Here, the ratio between the 
color used and its complimentary color is set to 1:2, however, the ratio may be changed based on the color used. 
[0172] By being previously provided with a mixing-ratio table containing the optimum mixing-ratio for each of the 

55 above-mentioned colors and color combinations, the mixing-ratio calculating section 4 may merely refer to the mixing- 
ratio table. This avoids the necessity of calculating every time, thereby speeding up the process. 
[0173] Further, in the case where the image conversion is performed image by image and that each of the images 
has a bias in color, the result of the image conversion sometimes differs, which causes uncomfortableness in turning 
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over the leaf of the electronic book viewed in a portable terminal such as a viewer. Thus, a plurality of images may be 
converted as a whole. Specifically, the image inputting section 2 inputs a plurality of images, and the color analyzing 
section 3 analyzes the color from the result of the integration of the color used in each image from among the plurality 
of images. The mixing-ratio calculating section 4 calculates a mixing-ratio common to all the input images, and the 
5 image converting section 5 converts all the images in the same mixing-ratio. Accordingly, images can be converted to 
monochromatic images more stably. 

[0174] Finally, the image converting section 5 converts each pixel into a monochromatic image M 0 based on the 
conversion formula 

10 M 0 = rR + gG + bB (where r + g + b = 1), 

using the mixing-ratio r:g:b of the respective R, G and B color components determined by the mixing-ratio calculating 
section 4. 

15 (Second Embodiment) 

[0175] Fig. 7 is a block diagram of an image processing apparatus 1 b in accordance with a second embodiment of 
the invention. The image processing apparatus 1b comprises an image inputting section 2, a mixing-ratio calculating 
section 4, an image converting section 5, an image outputting section 6 and a color specifying section 8. The image 
20 inputting section 2, the mixing-ratio calculating section 4, the image converting section 5, and the image outputting sec- 
tion 6 are identical to those of the above-mentioned image processing apparatus 1a, and hence, the description is omit- 
ted. The color specifying section 8 specifies the color used in the input image. 

[0176] Fig. 8 is a flow chart showing the image processing method of the image processing apparatus 1b. The 
image inputting section 2 inputs an image (S1). The color specifying section specifies the color used in the input image 
25 (S6). The mixing-ratio calculating section 4 determines the mixing-ratio r:g:b of the respective color components of R, 
G and B (S3). The image converting section 5 mixes the color components of R, G and B according to the mixing-ratio, 
thereby converting the input image to a monochromatic image (S4). The image outputting section 6 outputs the image 
(S5). 

[0177] The difference from Fig. 2 of the first embodiment is only the point that the step S2 is replaced by the step 
30 S6. In contrast to the image processing apparatus 1a automatically determining the color used in the input image, the 
image processing apparatus 1b semi-automatically determines it by a user externally specifying it through the color 
specifying section 8 implemented by a mouse or a keyboard. 

[01 78] The color specifying section 8 is described below. The color specifying section 8 permits a user to select the 
kind of the image from the group consisting of monochromatic, plural colors, one color other than black, and black plus 
35 one color other than black. When one color other than black or black plus one color other than black is selected, the 
color other than black is further selected from the group consisting of red (R), yellow (Y), green (G), cyan (C), blue (B) 
and magenta (M). Accordingly, by a user specifying the determination of the color, the image can be determined more 
accurately to be converted to a monochromatic image. 

40 (Third Embodiment) 

[01 79] Fig. 9 is a block diagram of an image processing apparatus 1 c in accordance with a third embodiment of the 
invention. The image processing apparatus 1c comprises an image inputting section 2, an image converting section 5, 
an image outputting section 6 and a mixing-ratio specifying section 9. The image inputting section 2, the image convert- 
45 ing section 5, and the image outputting section 6 are identical to those of the above-mentioned image processing appa- 
ratus 1a, and hence, the description is omitted. The mixing-ratio specifying section 9 specifies the mixing-ratio r:g:bof 
the respective color components of R, G and B. 

[0180] Fig. 8 is a flow chart showing the image processing method of the image processing apparatus 1b. The 
image inputting section 2 inputs an image (S1). The mixing-ratio specifying section 9 specifies the mixing-ratio r:g:b of 
so the respective color components of R, G and B (S7). The image converting section 5 mixes the color components of R, 
G and B according to the mixing-ratio, thereby converting the input image to a monochromatic image (S4). The image 
outputting section 6 outputs the image (S5). 

[0181] The difference from Fig. 2 of the first embodiment is only the point that the steps S2 and S3 are replaced by 
the step S7. In contrast to the image processing apparatus 1a automatically determining the color used in the input 
55 image and automatically determining also the mixing-ratio, the image processing apparatus 1c semi-automatically 
determines the mixing-ratio by a user externally specifying the mixing-ratio of the color components through the mixing- 
ratio specifying section 9 implemented by a mouse or a keyboard. 

[0182] The mixing-ratio specifying section 9 is described below. The mixing-ratio specifying section 9 permits a 
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user to select the mixing-ratio r:g:b of the R, G and B components. Accordingly, the color components can be mixed in 
the ratio desired by a user, resulting in a desirable monochromatic image. 

[0183] The processes shown in the first to the third embodiments are implemented with a program. The program 
may be recorded on a computer-readable recording medium, such as an optical disk and a floppy disk, to be used after 
being read out when necessary. An image processing apparatus and an image processing method each for such a 
process are also included within the scope of the invention. 

(Fourth Embodiment) 

[0184] Fig. 1 1 is a block diagram of an image processing apparatus 21a in accordance with a fourth embodiment 
of the invention. The image processing apparatus 21a comprises an image inputting section 22, a character/line draw- 
ing region extracting section 23, a pseudo-density region extracting section 24, an image contracting section 25, and 
an image outputting section 26. The image inputting section 22 inputs an image. The character/line drawing region 
extracting section 23 extracts a character/line drawing region. The pseudo-density region extracting section 24 extracts 
a pseudo-density region from the input image and the extracted results of the character/line drawing region extracting 
section 23. The image contracting section 25 performs a contracting process by different methods respectively in the 
character/line drawing region, the pseudo-density region and the region other than the character/line drawing region 
and the pseudo-density region. The image outputting section 26 outputs the processed image. 
[0185] The image inputting section 22 and the image outputting section 26 are implemented similarly to the image 
inputting section 2 and the image outputting section 6, respectively. 

[0186] The character/line drawing region extracting section 23 performs a smoothing process on the input image, 
and then performs edge extraction thereof. The smoothing process permits to extract the edge component alone of a 
character and a line drawing after accurately eliminating the pseudo-density region even when the line drawing exists 
within a pseudo-density region. In the smoothing process, a filter such as 
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is used to simply average the pixel density in the periphery. Although the size of the filter is 5x5 here, it may be changed 
depending on the resolution of the original image. Further, the filter used may be a Gaussian filter and the like in which 
40 the central part and the peripheral part are differently weighted. In the edge extraction, two edge extracting filters such 
as 
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are used to obtain the result of edge extraction which is defined by the sum of the absolute value of the output of each 
filter. 

[0187] Using the result of the edge extraction, a pixel having a value exceeding a predetermined threshold value is 
determined as a character/line drawing region. An isolated point and the like among the pixels having a value exceeding 
5 the predetermined threshold value can be excluded from the character/line drawing region, considering it as a noise. A 
small region surrounded by edges can be included in a character region, because it can be considered as a compli- 
cated character area. 

[0188] The pseudo-density region extracting section 24 is described below. The pseudo-density region extracting 
section 24 calculates the dispersion of the peripheral pixels, and extracts, as a pseudo-density region, the pixel which 

10 is one of the pixels having a large dispersion and is not included in the character/line drawing region extracted by the 
character/line drawing region extracting section 23. This depends on the fact that the pseudo-density region alone can 
be extracted by excluding the character/line drawing regions from the pixels having a large dispersion, because the dis- 
persion is large both in a pseudo-density region and in the edge portion of the character/line drawing region. 
[0189] Fig. 1 2 is a diagram for describing the area in which the dispersion is calculated for a pixel of interest. In Fig. 

15 12, the shaded portion is a pixel of interest, and the area surrounded by thick lines is the area to calculate the disper- 
sion. Although the dispersion for each pixel is calculated in a 5 x5 region in Fig. 12, the size of the region may be 
changed depending on the resolution of the original image. The dispersion for each pixel is obtained by 
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25 Here, Pj is the pixel value, m is the average of the pixel density within the region to survey the dispersion, and n is the 
number of pixels included within the region to survey the dispersion. 

[0190] The image contracting section 25 is described below. The image contracting section 25 contracts the 
pseudo-density region by a smoothing process, contracts the character/line drawing region by contraction due to an 
averaging process and by a subsequent edge enhancing process, and contracts the region other than the pseudo-den- 

30 sity region and the character/line drawing region by the averaging process alone. Accordingly, a moire is prevented in 
the pseudo-density region. In the character/line drawing region, unclearness and blurring are prevented by the averag- 
ing process, and the clearness is kept by the edge enhancing process. In region other than the pseudo-density region 
and the character/line drawing region, the performing of the averaging process alone prevents unnecessary blurring by 
a smoothing process and the increase in noise by unnecessary edge enhancement. In the case where a character/line 

35 drawing region and a pseudo-density region are in the near vicinity, the averaging process and the edge enhancing 
process occurs in the near vicinity, whereby the image quality extremely changes. Thus, the boundary pixels may be 
set as a region other than the pseudo-density region and the character/line drawing region, whereby the image quality 
changes smoothly. 

[0191] Fig. 13 is a diagram for describing the contracting process by averaging. In Fig. 13, the small lattice, which 
40 is shown by broken lines, is the lattice of the original image, and the large lattice shown by thick lines is the lattice of the 
contracted image. The contracted image is on a scale of 1/2 of the original image for simplicity, however, the scale is 
not necessarily a reciprocal number of a whole number. In the case where the scale is not a reciprocal number of a 
whole number, the lattices of the original image and the contracted image does not coincide. In that case, for example, 
a coordinate value may be rounded into a whole number, or a pixel may be averaged with a weight corresponding to the 
45 ratio of the areas common to the lattices. The pixel value of the pixel Pm of interest shown in Fig. 1 3 is obtained by aver- 
aging the shaded pixels. 

[0192] Fig. 14 is a diagram for describing the contracting process by smoothing. In Fig. 14, a small lattice which is 
shown by broken lines is a lattice of the original image, and the large lattice shown by thick lines is the lattice of the con- 
tracted image. The pixel value of the pixel Pb of interest shown in Fig. 14 is obtained by averaging the shaded pixels 
so which extend into the rather wider area than the lattice of the contracted image. The area to perform the smoothing may 
be changed depending on the contraction ratio and the resolution of the original image. 
[0193] The edge enhancement is performed using a filter such as 
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10 Performing the edge enhancing process on the contracted image permits to clarify the dullness of the image due to the 
contraction by the averaging process. 

(Fifth Embodiment) 

15 [0194] Fig. 15 is a block diagram of an image processing apparatus 21b in accordance with a fifth embodiment of 
the invention. The image processing apparatus 21b comprises an image inputting section 22, a character/line drawing 
region extracting section 23, an image contracting section 25, an image outputting section 26 and a pseudo-density 
region extracting section 27. The image inputting section 22 inputs an image. The character/line drawing region extract- 
ing section 23 extracts a character/line drawing region. The pseudo-density region extracting section 27 extracts a 

20 pseudo-density region from the input image and the results of the character/line drawing region extracting section 23. 
The image contracting section 25 performs a contracting process by different methods respectively in the character/line 
drawing region, the pseudo-density region and the region other than the character/line drawing region and the pseudo- 
density region. The image outputting section 26 outputs the processed image. The image inputting section 22, the char- 
acter/line drawing region extracting section 23, the image contracting section 25 and the image outputting section 26 

25 are implemented similarly to those of the image processing apparatus 21a, and hence, the description is omitted. 
[0195] The pseudo-density region extracting section 27 calculates the correlation of the periphery of a pixel of inter- 
est and extracts, as a pseudo-density region, a pixel which is one of the pixels having a low correlation and is not 
included in the character/line drawing region extracted by the character/line drawing region extracting section 23. Since 
the pseudo-density region has a low correlation with the peripheral pixels, and since the edge portion has a large cor- 

30 relation in any of the vertical, horizontal and oblique directions, the probability is decreased that a character and a line 
drawing portion are classified into a pseudo-density region. 

[0196] Fig. 16 is a diagram for describing the method of calculating the correlation of peripheral pixels. First, a ref- 
erence region which is a region containing a pixel of interest is defined. Comparative regions Bi (i = 1 , 2, 3, 4) each of 
which is a shifted region of the reference region A in any of the four of vertical, horizontal and oblique directions: (+1, 
35 0), (+1 , +1), (0, +1), (-1 , -1) in (x, y) direction are defined. The value of correlation C for the pixel of interest is obtained by 



[0197] Where |A — Bi| represents the total sum of the absolute values of the differences between the corresponding 
pixels in the regions A and B, n is the number of the pixels in the region, and Min indicates the minimum within i = 1 , 
4. The image processing apparatus 21b calculates the value of correlation by the difference between the regions, how- 
ever, the other methods may be used. A larger value of correlation C indicates a lower correlation, and a smaller value 
45 indicates a higher correlation. Since vertical, horizontal, and oblique lines has a large correlation in any of the above- 
mentioned four directions, they can be excluded from a pseudo-density region at an early stage, thereby permitting to 
extract a pseudo-density region more accurately. 

[0198] The pseudo-density region extracting section 27 extracts, as a pseudo-density region, a pixel which is one 
of the pixels having an above-mentioned value of correlation greater than a predetermined value (having a low correla- 
50 tion) and is not extracted by the character/line drawing region extracting section 23. Accordingly, pseudo-density 
regions alone can be accurately extracted. 

(Sixth Embodiment) 

55 [0199] The image processing apparatus in accordance with a sixth embodiment is the image processing apparatus 
21a of the fourth embodiment or the image processing apparatus 21b of the fifth embodiment with the pseudo-density 
region extracting sections 24, 27 changed. The other components are implemented similarly to those of the image 
processing apparatuses 21a, 21b of the fourth and the fifth embodiments, and hence, the description is omitted. The 
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pseudo-density region extracting section of the image processing apparatus in accordance with the sixth embodiment 
detects the edge detection of an image and extracts, as a pseudo-density region, a pixel which is one of the pixels hav- 
ing a large edge value and is not included in the character/line drawing region extracted by the character/line drawing 
region extracting section 23. This depends on the fact that the pseudo-density region alone can be extracted by exclud- 

5 ing the character/line drawing regions from the pixels having a large edge value, because the output of a edge detecting 
filter is large both in a pseudo-density region and in the edge portion of the character/line drawing region. 
[0200] Fig. 1 7 is a flow chart showing the image processing method of the image processing apparatus in accord- 
ance with the seventeenth to the twenty-third inventions. A step S31 is a process module for inputting an image, that is, 
a process module for reading an image from an image inputting apparatus, such as a scanner, or a storage medium 

10 into a memory of the image contracting apparatus. A step 32 is a process module for extracting a character/line drawing 
region, and extracts the character/line drawing region by edge extraction after performing a smoothing process on the 
input image. A step S33 is a process module for extracting a pseudo-density region and extracts the pseudo-density 
region by the method described in the fourth, the fifth and the sixth embodiments. A step S34 is a process module for 
performing the image contracting process described in the fourth, the fifth and the sixth embodiments on the charac- 

15 ter/line drawing region and the pseudo-density region extracted by the process modules of the steps S32, S33. A step 
S35 is a process module for outputting the image contracted by the step S34 into the image outputting section 26. 
[0201] Fig. 18 is a flow chart showing the image processing method of the image processing apparatus in accord- 
ance with the twenty-fourth invention. Steps S40-S43 are process modules for performing the same processes as the 
steps S31-S34 of Fig. 17, and hence, the description is omitted. A step S44 detects an edge of a pseudo-density region 

20 already contracted. Since the pseudo-density region is processed by the smoothing process, the edge value normally 
should not be large. However, in the case of the occurrence of a moire, an edge should be detected. 
[0202] A step S45 is a process module for performing the smoothing process only on the pixels (for example, 60) 
having an edge value which is detected by the step S44 and is greater than or equal to a predetermined value. Accord- 
ingly, it is characterized by performing the smoothing process on the contracted image. A step S46 is a process module 

25 for outputting the image, and performs the same process as the step S35. 

[0203] Fig. 1 9 is a flow chart showing the image processing method of the image processing apparatus in accord- 
ance with the twenty-fifth invention. Steps S50-S53 are process modules for performing the same processes as the 
steps S31-S34 of Fig. 17 and the steps S40-S43 of Fig. 18. A step S54 detects an edge of a pseudo-density region 
already contracted. Since the pseudo-density region is processed by the smoothing process, the edge value normally 

30 should not be large. However, in the case of the occurrence of a moire, an edge should be detected. 

[0204] In the case where there exists a pixel (for example, 60) having an edge value which is detected by the step 
S54 and is greater than or equal to a predetermined value, a step S55 interrupts the contracting process, indicating the 
occurrence of a moire (step S57). It may merely generate the warning, in stead. In the case where there is not a pixel 
having an edge value greater than or equal to a predetermined value, the step S55 outputs the image and terminates 

35 (stepS56). 

(Seventh Embodiment) 

[0205] Fig. 20 is a block diagram of an image processing apparatus 31a in accordance with a seventh embodiment 

40 of the invention. The image processing apparatus 31a comprises an image inputting section 32, an image reversing 
sections 33a, 33b, a positional relationship detecting section 34, an image correcting section 35 and an image output- 
ting section 36. The image inputting section 32 inputs the front and back images of an original. The first image reversing 
section 33a reverses the right and left of the back image alone. The positional relationship detecting section 34 detects 
the positional relationship between the front and back images. The image correcting section 35 eliminates a ghost 

45 image from each of the front and back images by a calculating process on the front and back images depending on the 
positional relationship of the front and back images. The second image reversing section 33b recovers the orientation 
of the back image by reverting again the right and left of the back image. The image outputting section 36 outputs the 
corrected front and back images. The output can be used as an electronic book. The image inputting section 32 and 
the image outputting section 36 can be implemented similarly to those of the image inputting section 2 and the image 

so outputting section 6, and hence, the description is omitted. 

[0206] The first image reversing section 33a reverses the right and left of the back image. The front image may be 
reversed. Since the image on the opposite side which causes a ghost image is in the reversed orientation of right and 
left, the back image is reversed before the calculating process by the positional relationship detecting section 34 and 
the image correcting section 35. After the correcting process, the corrected back image is reversed again by the second 

55 image reversing section 33b, thereby recovering the normal orientation. The image reversing sections 33a, 33b may 
have an identical configuration. 

[0207] Fig. 21 is a diagram for describing the positional relationship detecting section 34. The positional relation- 
ship detecting section 34 is implement, for example, by a block matching section. A reference region F having a size of 
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(mxn) is defined on the front image side, and a comparative region G having a size of (sxt) larger than the reference 
region F is defined on the back image side. The comparative region G is compared with the reference region F thereby 
to obtain a region having the highest similarity to the reference region F. In other words, let the top left point of the ref- 
erence region F be (0, 0), and any top left point of the comparative region G be (u, v). Then, the comparison between 
5 an arbitrary point (k, I) of the reference region F and the corresponding point (k+u, l+v) of the comparative region G is 
carried out by the following Formula (8). 

n-1 m-1 

d(u,v)=2 X |G(k+u,l + v)-F(k,l)| (8) 

10 k=0 l=0 

[0208] The region of the comparative region G which locates the position such that the point d(u, v) of the Formula 

(8) becomes minimum is determined as having the highest similarity to the reference region F, thereby detecting the 
coincidence of the comparative region G with the reference region F. 

15 [0209] Knowing the positional relationship of the correspondence between the front and back images, the amount 
of the shift (Ox, Oy) of the back image with respect to the front image can be obtained from the difference between the 
positions of the comparative region G and the reference region F. 

[0210] In the embodiment, the block matching is carried out in one reference region F, thereby obtaining the amount 
of parallel displacement only. However, the block matching may be carried out in two or more reference regions F, 

20 thereby detecting also the amount of rotation. 

[0211] Since a ghost image has very low brightness and contrast in comparison with the original image, there is an 
anxiety that the direct comparison between the front and back images during the block matching can results in a wrong 
detection of the position due to the strong influence of the original image on each side. Thus, the invention comprises 
high brightness component extracting means for previously extracting the high brightness component alone before the 

25 positional relationship detecting section 34, thereby performing the block matching using the high brightness compo- 
nent alone, thereby achieving more accurate detection of the position. 

[0212] Fig. 22 is a graph for describing the mean for extracting a high brightness component. In the graph of Fig. 
22, the horizontal axis indicates the input pixel value, and the vertical axis indicates the output pixel value. In the graph 
of Fig. 22, the pixel value represents the brightness and has a value of 0-255. A value nearer to -0 is determined as a 

30 lower brightness (black), and a value nearer to 255 as a higher brightness (white). However, this relationship may be 
reversed, the value is not necessarily a whole number, and the range is not necessarily 0-255. 
[021 3] The means for extracting a high brightness component converts the pixel value alone of the input image hav- 
ing a pixel value greater than or equal to Lt into a value of 0-255, thereby cutting off a low brightness component to 
extract the high brightness component alone. The pixel value Lt is previously set to a value lower than the brightness of 

35 a ghost image component, and depends on the transmittance of an original sheet, the sensitivity characteristics of a 
scanner, and the like. 

[0214] The operation of the image correcting section 35 is described below with reference to the following Formulae 

(9) -(12). The following a and b represent the actually printed front and back images, respectively. The A and B represent 
the front and back images, respectively, which are read by the image inputting section 32 and includes a ghost image. 

40 For the simplicity of description, a, b, A and B represent the respective pixel values corresponding to each other in an 
identical position. However, in practice, the corresponding pixels are determined by the positional relationship detecting 
section 34 considering a parallel displacement and a rotation. 



45 



A = a - r(255 - b) (9) 
B = b-r(255-a) (10) 



3 _ A+r(255-B)-255r 2 
so " 1-r 2 

b _ B+r(255-A)-255r 2 (12) 
1-r 2 

55 

[0215] The r represents the transmittance of the medium, such as an original sheet, on which the image is printed. 
It can be obtained by substituting the known or measured values for A, a and b in Formula (9). 
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[0216] The Formulae (9) and (10) are solved, resulting in Formulae (1 1) and (12). That is, by the calculating proc- 
ess of the photographed front image A and back image B, the actual front image a and back image b can be recovered 
eliminating a ghost image. The image correcting section 35 performs the calculation of the above-mentioned Formulae 
(11) and (12) and outputs the front image a and the back image b. 

[0217] The image processing apparatus 31a can be implemented by a computer-readable recording medium, such 
as a floppy a ROM and a CD, which records a program describing the process steps of the image reversing sections 
33a, 33b, the positional relationship detecting section 34 and the image correcting section 35 described above. 

(Eighth Embodiment) 

[0218] Fig. 23 is a block diagram of an image processing apparatus 31 b in accordance with an eighth embodiment 
of the invention. The image processing apparatus 31b comprises an image inputting section 32, an image outputting 
section 36, an edge detecting section 37 and an image correcting section 38. The image inputting section 32 inputs an 
image. The edge detecting section 37 detects an edge. The image correcting section 38 eliminates a ghost image by 
raising the brightness of a pixel other than the edge and a low brightness region. The image outputting section 36 out- 
puts the corrected image. The image inputting section 32 and the image outputting section 36 of the image processing 
apparatus 3 1 b are implemented similarly to those of the image inputting section 32 and the image outputting section 36 
of the image processing apparatus 31a, and hence, the description is omitted. 

[0219] In the edge detection by the edge detecting section 37, two edge detection filters such as Equations (13) and 
(14) are used, and the result of the edge detection is defined by the sum of the absolute value of the outputs of the 
respective filters. Using the result of the edge detection, a pixel having a value exceeding a predetermined threshold 
value is determined as an edge. 
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[0220] Fig. 24 is a graph for describing the operation of the image correcting section 38. Let the pixel value in the 
periphery of a ghost image component the input pixel value of which is previously known be t2, and a pixel value appro- 
priately smaller than the pixel value t2 be t1 . Then, the image correcting section 38 corrects a ghost image by changing 
the relationship (inclination) to the output pixel value between the pixel value t1 and the pixel value t2 to correct the out- 
put pixel value so as to saturate at the pixel value t2 and above. The pixel values t1, t2 depend on the transmittance of 
an original sheet, the sensitivity characteristics of a scanner, and the like. Here, since there is no influence on the low 
brightness component having a pixel value smaller than or equal to t1 , the whitening- out of a black portion can be pre- 
vented. Further, the brightness correction is not carried out in the edge portion detected by the edge detecting section 
37, whereby the high brightness portion in the contour of a character is conserved, whereby the unclearness of a char- 
acter can be prevented. 

[0221] The image processing apparatus 31 b can be implemented by a computer-readable recording medium such 
as a floppy, a ROM and a CD, which records a program describing the process steps of the edge detecting section 37 
and the image correcting section 38 described above. 

(Ninth Embodiment) 

[0222] Fig. 25 is a block diagram of an image processing apparatus 31c in accordance with a ninth embodiment of 
the invention. The image processing apparatus 31c comprises an image inputting section 32, an image outputting sec- 
tion 36, an edge detecting section 37, an image dividing section 39 and an image correcting section 40 The image 
inputting section 32 inputs an image. The edge detecting section 37 detects an edge. The image dividing section 39 



24 



EP1 100 257 A1 



divides the image at the detected edge and low brightness component. The image correcting section 40 eliminates a 
ghost image by raising the brightness of a portion having a high average brightness within the divided region. The 
image outputting section 36 outputs the corrected image. The image inputting section 32, the image outputting section 
36 and the edge detecting section 37 of the image processing apparatus 31c are implemented similarly to those of the 
5 image inputting section 32, the image outputting section 36 and the edge detecting section 37 of the image processing 
apparatus 31b, and hence, the description is omitted. 

[0223] The image dividing section 39 divides an image region based on the edge and the pixel value exceeding a 
predetermined threshold value detected by the edge detecting section 37. For example, as shown in Fig. 26, the image 
dividing section 39 divides the image into regions 1-5. The region 1 is a surrounded region having a character, the 

10 region 2 is a base region, the region 3 is a black halftone region, the region 4 is a thin halftone region, and the region 5 
is a thick halftone region. Assume that the regions 1-5 does not include a black pixel or an edge portion, such as a char- 
acter. Further assume that a ghost image having the same brightness as the region 4 exists in the regions 1 and 2. The 
regions 3-5 using a halftone screen have a low average brightness, however, the regions 1 and 2 have a high average 
brightness because of the white background. Accordingly, by performing a brightness correction in the high average 

15 brightness regions 1 and 2 alone, the ghost image in the regions 1 and 2 can be eliminated with the halftone in the 
region 4 preserved even when the regions 1 and 2 have a ghost image having the same brightness as the region 4. 
Accordingly, a black region in an image is excluded from the region to correct a ghost image because of the unremark- 
aWeness of a ghost image. 

[0224] The image correcting section 40 calculates the average brightness in a region divided by the image dividing 

20 section 39, and corrects the brightness of a high brightness portion by the similar method of Fig. 24 described in the 
eighth embodiment only when the brightness is greater than or equal to a predetermined value, thereby eliminating a 
ghost image. As described above, by performing the ghost-image correction in high average brightness regions alone, 
even a halftone portion having the same brightness as a ghost image can be prevented from the whitening-out of the 
uniform region surrounded by lines. Further, since black regions and edge portions are excluded, the unclearness of a 

25 character and the whitening-out of a black portion are prevented. 

[0225] The image correcting section 40 automatically calculates the pixel value t2 of the Fig. 24 from the distribution 
of the pixel values in a high brightness region. Fig. 27 is a graph for describing the method of calculating the pixel value 
t2. First, the histogram of the pixel values of a high brightness region is prepared, and pixel values tmin and tmax are 
defined. When all the pixels of the high brightness region exist in the right of tmax, set t2 = tmax . When all the pixels 

30 of the high brightness region exist in the left of tmin, set t2 = tmin . When the pixel having the minimum exists between 
tmin and tmax, let the value be the pixel value t2. Since a ghost image portion is darker than the peripheral region, the 
ghost image can be eliminated by detecting the pixel value and by correcting it so as to be white. 
[0226] The image processing apparatus 31c can be implemented by a computer-readable recording medium, such 
as a floppy, a ROM and a CD, which records a program describing the process steps of the edge detecting section 37, 

35 image dividing section 39 and the image correcting section 40 described above. 

(Tenth Embodiment) 

[0227] Fig. 28 is a block diagram of an image processing apparatus 50 in accordance with a tenth embodiment of 

40 the invention. In the image processing apparatus 50, an image inputting section 51 reads the image data page by page 
from an original of a book separated into pages. A page contour detecting section 52, a page contents region extracting 
section 53, an inclination correcting section 54, a page position correcting section 55 and a page information processing 
section 57 perform the processes described later using various buffers. The image outputting section 56 outputs the 
image data in which the alignment between the pages is corrected. 

45 [0228] Fig. 29 is a schematic diagram showing the configuration of a novel book as an example of a book inputted 
to the image processing apparatus 50. In Fig. 29, the book inputted to the image processing apparatus 50 consists of 
a title (cover) page, contents table pages, main-text pages (even pages and odd pages), index pages and a back cover 
page. A majority of the pages are main-text pages each having a header region (shows a page number in the present 
example), a footer region (shows a chapter number in the example) and a contents region (main-text region) in a fixed 

so position. The image processing apparatus 50 aligns the pages using such a feature. 

[0229] The processes by respective sections of the image processing apparatus 50 are described below. The 
image inputting section 51 reads a binary or multi-valued image from a scanner and the like, and saves it in an input 
image buffer 58. This image may be a monochromatic image or a color image. The orientation of the image input is 
roughly correct, and the input is carried out in the sequence of the pages from the first or the last. In the case of the 

55 reading by a scanner and the like, it is preferable that the input region of the scanner is larger than the size of a page, 
considering the case of the inclined input due to the error of an automatic feeder, if used. This situation is assumed in 
the following description. When a page is larger than the input region of the scanner, it can be inputted in divided pieces 
and reconstructed in the input image buffer 58. 
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[0230] The page contour detecting section 52 is described below. Since the page is smaller than the input region 
of the scanner, the image inputted by the image inputting section 51 consists of an actual page region of the book and 
a background region behind it. The page contour detecting section 52 discriminates between the background region 
and the page region form the input image, thereby extracts the contour of the page region. Here, in the case where a 

5 book is used after being separated into pages, a page sometimes has the inclined or torn edge corresponding to the 
back portion. In that case, the contour is not an accurate rectangle, but is assumed to be approximated by a rectangle. 
[0231] The methods for detecting the contour of a page region include a method in which an edge portion is 
detected from the image thereby detecting the fact that each angle of the rectangle is 90 degree from the edge point, a 
method in which an ensemble of edge points having a large change in brightness is extracted thereby obtaining a 

10 straight line from the ensemble thereby extracting the contour and the like. 

[0232] An example of a technique of detecting the contour of a page region is described below with reference to 
Figs. 30 and 31 . Fig. 30 is a diagram for describing this technique. Fig. 31 is a flow chart for describing this technique. 
Since the contour of a page region is a rectangle, a method of detecting the four straight lines in the outermost location 
of the image is described herein. 

15 [0233] First, description is made for the case of detecting a contour line in the left side of the page region shown in 
Fig. 30(a) (S61 , S62). A line to scan is selected firstly (S63). The top row is selected here because the scan is carried 
out horizontally. Since the scan is carried out from left to right, the left end is set to the initial value (i=0) (S64). Scanning 
the image sequentially, the brightness of each point is acquired from the input image buffer 58 (S56). Determination is 
carried out whether the point is an edge point or not (S66). The method of the determination is to calculate the first- 

20 order differential in the horizontal direction. An example of this is the method using a Sorbel filter. When the point is 
determined as an edge point, the coordinate of the point is stored (S69), the scanning of the line is terminated, and the 
next line is selected. Such a scan is carried out through all the lines to the bottom row (S69). When the point is deter- 
mined not as an edge point, it is determined whether an edge of the image or not (S67). When it is determined as an 
edge of the image, it proceeds to S69. When it is determined not as an edge of the image, i=i+1 is set (S68), and it 

25 returns to S65. As a result, an ensemble of the coordinate of the edge points is obtained. A majority of these accumu- 
late on a straight line. Thus, the straight line is calculated. This is typically carried out by the half transformation (S71). 
The process described above is carried out in each of the four directions (corresponding to D=0-3 in the flow of Fig. 31) 
of the input image (Fig. 30(b)) (S72), thereby obtaining four straight lines (S73), thereby detecting these straight lines 
as the contour of the page region (Fig. 30(c)) (S74). 

30 [0234] The page contents region extracting section 53 is described below with reference to Figs. 32 and 33. The 
page contents region extracting section 53 extracts a page contents region from the image within the contour of the 
page region obtained by the page contour detecting section 52. Fig. 32 is a diagram for describing this technique. Fig. 
33 is a flow chart for describing this technique. 

[0235] As shown in Fig. 32(a), scanning the image in the sequence of the lines (S61, S62), an edge point is 
35 extracted. This is by the same method as the page contour detecting section 52. This edge point may be an edge of a 
character, a section line in a figure or table, or an edge of a balloon of a cartoon. However, an edge point of a character 
region is to be obtained in the present example. In the case of a character string and the like, the obtained edge point 
ensemble does not exists on a straight line. Thus, obtaining the lines (straight lines) circumscribing such an edge 
ensemble (Fig. 32(b)), the straight lines are set as the boundary of the page contents region (Fig. 32(c)) herein. 
40 [0236] The method of obtaining the circumscribing line is described again with reference to Fig. 33. First, an edge 
point ensemble is obtained (S75). Selecting two points from the edge point ensemble, the equation of the straight line 
passing through the two points is obtained (S76). The equation of the straight line is 

(y2— y1) x— (x2— x1) y— <x1y2— x2y1) = 0 

45 

with the coordinate of the two points (x1, y1) and (x2, y2). 

[0237] It is determined on which side of the straight line another edge point not selected exists (S77). The deter- 
mining equation is 

50 F(x, y) = (y2— y1) x + (x2— x1) y— x1y2 + x2y1 

where the point (x, y) locates on the origin side when F(x, y) <0 and outside when F(x, y)>0. 
[0238] When all the points locate on the same side, the straight line is a circumscribing line. Otherwise, another two 
points are selected (S78-80). Repeating for all the combination, an circumscribing line can be obtained definitely. 
55 [0239] By carrying out the process described above in each of the four scanning directions (corresponding to D=0- 
3 in the flow of Fig. 33) (S72), four straight lines is obtained (S73), whereby the page contents region can be extracted 
as a figure surrounded by the circumscribing lines (Fig. 32(c)) (S74). 

[0240] The inclination correcting section 54 is described below. The inclination correcting section 54 performs the 
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process of rotating with respect to the reference coordinate axes based on the figure of the circumscribing lines 
extracted by the page contents region extracting section 53, thereby correcting the inclination of the input image. The 
process is carried out on all the pages of the book. 

[0241] Fig. 34 is a diagram showing the situation of the image rotation. The center of the rotating conversion is set 
5 to the coordinate (cx, cy) of an comer of the page contents region. In a rotation of the input image by 6 , the coordinate 
of a point on the input image is (x, y) and the coordinate of a point on the corrected image after the conversion is (x\ y'). 
The conversion formula of this rotation is 

10 x' cos<0) - sin (0) x - cx cx 

( y' } " ( sin (0) cos (0) ) ( y - cy ) + cy 



15 

[0242] In the rotating process, this formula is applied to each pixel on the input image buffer 58, thereby assigning 
a brightness or a color to the converted coordinate on a corrected image buffer 59. 

[0243] The page information processing section 57 is described below. The page information processing section 
57 determines whether the input image of a book is a main-text page or the other page. The method of the determina- 

20 tion is a method in which the size or the shape of the figure of the circumscribing lines extracted by the page contents 
region extracting section 53 is compared and it is determined as a main-text page when the size or the shape is within 
a predetermined range. An alternative method is a method in which consecutive pages are determined as the main-text 
pages during the consecutive pages having an almost constant size of the rectangle of the circumscribing lines con- 
tinue. This method depends on the fact that the input is carried out in the sequence of the pages and that the main-text 

25 pages have an almost constant size of the rectangle of the circumscribing lines detected by the page contents region 
extracting section 53. Another alternative method is a method in which the first page of and the last page (sheet num- 
bers) of the main-text pages are previously specified externally. This method also depends on the fact that the input is 
carried out in the sequence of the pages. Further, when determining as a main-text page, the page information process- 
ing section 57 stores the positional information of the page contents region in the rectangle of the circumscribing lines 

30 into a page positional information buffer 60, and uses it as a template for aligning the main-text images and, hence, the 
pages. When the page positional information buffer 60 already contains the positional information of the template indi- 
cating a main-text page used as a reference for the page alignment, it proceeds to the page position correcting section 
55. 

[0244] The page position correcting section 55 is described below. Although the inclination of an input image is cor- 
35 rected, the position of the page contents region of the main-text page varies image by image because of mechanical 
deviation and the like during the reading. If the intact main-text pages are outputted as an electronic book without posi- 
tion correction, the positional variation occurs during the viewing of the contents of the main-text pages in a viewer and 
the like, which causes uncomfortableness. Thus, the page position correcting section 55 corrects, using a parallel dis- 
placement, the position of the images of the main-text pages the inclination of which is corrected, so as to coincide with 
40 the positional information of the template indicating a main-text page stored in the page positional information buffer 60. 
As a result, the image outputting section 56 can provide the image data in which the main-text pages are aligned. In 
other words, once the template is obtained from a page determined as a main-text page, the subsequent main-text 
pages are aligned with the reference to the template. 

[0245] The above-mentioned template includes all of the header region, the footer region and the contents region 
45 of a main-text page. However, each region may be separated as shown in Fig. 35(a), and stored into the page positional 
information buffer 60 in the form shown in Fig. 35(b). Such a separation simplifies character recognition, key word 
extraction, and the like, thereby simplifying the structuring of a document. 

[0246] In the above-mentioned description, all the processes are automated. However, the processes of the page 
contour detecting section 52, the page contents region extracting section 53, and the inclination correcting section 54 
so may be carried out manually. 

(Eleventh Embodiment) 

[0247] The images of a book is ordinarily inputted automatically and sequentially. Accordingly, whether the next 
55 input is a main-text page or the other is not known at the time of the input. Further, even in the case of a main-text page, 
the size of the page contents region differs, for example, in the last page of a chapter. Thus, even in the case where a 
page is determined as a main-text page, when the positional information of the page contents region of the newly input 
image differs from the positional information of the template in the page positional information buffer 60 (when the posi- 
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tional information is out of a predetermined range), an error is concluded, an error bit is written into an error buffer (not 
shown) page by page, and warning data is generated and maintained. Accordingly, a user can easily recognize the 
pages the error of which is to be corrected by a manual process, by watching the warning data from the error buffer 
through display means (not shown) after the completion of the automatic process of the whole book. 
5 [0248] The series of the above-mentioned processes can implemented with a program. The program may be 
recorded on a computer-readable recording medium, such as an optical disk and a floppy disk, to be used after being 
read out when necessary. 

[0249] The invention may be embodied in other specific forms without departing from the spirit or essential charac- 
teristics thereof. The embodiments are therefore to be considered in all respects as illustrative and not restrictive, the 
10 scope of the invention being indicated by the appended claims rather than by the foregoing description and all changes 
which come within the meaning and the range of equivalency of the claims are therefore intended to be embraced 
therein. 

Industrial Applicability 

15 

[0250] In accordance with the first invention, it is possible to produce a monochromatic image in such a manner that 
the color analyzing means analyzes the color used within the image inputted from the image inputting means, the mix- 
ing-ratio calculating means calculates the mixing-ratio of color components such as red, green and blue based on the 
analyzed color, and the converting means mixes color components according to the calculated mixing-ratio. By such an 
20 image processing apparatus, the color of the input image is automatically determined and a monochromatic image can 
be produced. 

[0251] In accordance with the second invention, it is possible to produce a monochromatic image in such a manner 
that the color analyzing means analyzes colors used within a plurality of images inputted from the image inputting 
means, the mixing-ratio calculating means calculates the mixing-ratios of color components which are common to the 

25 plurality of images, based on the analyzed color, and the converting means mixes color components according to the 
calculated mixing-ratios. By such an image processing apparatus, the colors of the plurality of input images are auto- 
matically determined and monochromatic images can be produced. Further, since the color determination is carried out 
in the plurality of input images, the color can be determined more accurately. Furthermore, since monochromatic 
images are produced in the same conditions for the plurality of input images, the images can be produced stably. 

30 [0252] In accordance with the third invention, it is possible to produce a monochromatic image in such a manner 
that an image is inputted from the image inputting means, the color specifying means specifies the color used within the 
image, the mixing-ratio calculating means calculates the mixing-ratio of color components based on the specified color, 
the converting means mixes the color components according to the calculated mixing-ratio. By such an image process- 
ing apparatus, a monochromatic image with higher accuracy can be produced by specifying the color used within the 

35 input image by a user. 

[0253] In accordance with the fourth invention, an image is inputted from the image inputting means, the mixing- 
ratio specifying means specifies the mixing-ratio of color components for the image, and the converting means mixes 
the color components based on the specified mixing-ratio. By such an image processing apparatus, a desired mono- 
chromatic image can be produced by specifying the mixing-ratio of a color component by a user. 
40 [0254] In accordance with the fifth invention, data is inputted, the color used within the image is analyzed, the mix- 
ing-ratio of color components is calculated based on the analyzed color, and color components are mixed according to 
the calculated mixing-ratio. By such an image processing method, the color of the input image is automatically deter- 
mined and a monochromatic image can be produced. 

[0255] In accordance with the sixth invention, the color used within the image is analyzed based on the distribution 
45 of the hue, saturation and lightness of the input image. By such an image processing method, the color of the input 
image is automatically determined and a monochromatic image can be produced. 

[0256] In accordance with the seventh invention, the data of a plurality of original images is inputted, the colors 
used within the images are analyzed, the mixing-ratios of color components, common to the plurality of images, are cal- 
culated based on the analyzed colors, and color components are mixed according to the calculated mixing-ratio. By 
so such an image processing method, the colors of the plurality of input images are automatically determined and respec- 
tive monochromatic images can be produced. Further, since colors are determined from the plurality of input images, 
the colors can be determined more accurately. Furthermore, since monochromatic images are produced in the same 
conditions for the plurality of input images, the images can be produced stably. 

[0257] In accordance with the eighth invention, the color used within the input image is specified, the mixing-ratio 
55 of color components is calculated based on the color, and color components are mixed according to the calculated mix- 
ing-ratio. By such an image processing method, a monochromatic image with higher accuracy can be produced by 
specifying the color used within the input image by a user. 

[0258] In accordance with the ninth invention, the mixing-ratio is calculated by referring to the mixing-ratio table. By 
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such an image processing method, the color of the input image is automatically determined and a monochromatic 
image can be produced. Further, by calculating the mixing-ratio with reference to the mixing-ratio table, optimum mix- 
ing-ratio is rapidly obtained for each color used within the image. Thus, more optimum monochromatic image can be 
produced at high speed. 

5 [0259] In accordance with the tenth invention, the mixing-ratio is calculated according to the color components ratio 
of the complimentary color of the color used within the input image. By such an image processing method, the color of 
the input image is automatically determined and a monochromatic image with high contrast can be produced. 
[0260] In accordance with the eleventh invention, the mixing-ratio is calculated based on the color component ratio 
of the complimentary color of the color used within the input image and the color component ratio used within the input 

10 image. By such an image processing method, the color of the input image is automatically determined, and a high-con- 
trast monochromatic image in which the color used in the input image is easily discriminated from black can be pro- 
duced. 

[0261] In accordance with the twelfth invention, the mixing-ratio of the color components of the input image is spec- 
ified, and color components are mixed according to the mixing-ratio. By such an image processing method, a desired 

15 monochromatic image can be produced by specifying the mixing-ratio of a color component by a user. 

[0262] In accordance with the thirteenth invention, a computer analyzes a color used within an input image, calcu- 
lates the mixing-ratio of color components based on the color, and mixes the color components according to the mixing- 
ratio. Accordingly, a medium can be provided which records an image processing program such that the color of the 
input image is automatically determined and a monochromatic image is produced. 

20 [0263] In accordance with the fourteenth invention, a computer analyzes the colors used within a plurality of input 
images, calculates the mixing-ratios of color components, common to the plurality of input images, based on the colors, 
and mixes the color components according to the mixing-ratios. Accordingly, a medium can be provided on which an 
image processing program is recorded such that the colors of the plurality of input images are automatically determined 
and monochromatic images are produced. 

25 [0264] In accordance with the fifteenth invention, a medium can be provided on which an image processing pro- 
gram of a computer for producing a monochromatic image with higher accuracy by specifying a color used within an 
input image by a user is recorded, the image processing program comprising the steps of specifying a color used within 
an input image, calculating a mixing-ratio of color components based on the color, mixing color components according 
to the mixing-ratio, and producing a monochromatic image with higher accuracy. 

30 [0265] In accordance with the sixteenth invention, a computer specifies a mixing-ratio for an input image, and mixes 
the color components according to the specified mixing-ratio. Accordingly, a medium can be provided on which an 
image processing program is recorded such that a desired monochromatic image is produced by a user specifying the 
mixing-ratio of a color component. 

[0266] In accordance with the seventeenth invention, the image inputting means inputs an image, from the image 
35 the character/line drawing region extracting means extracts a character/line drawing region and the pseudo-density 
region extracting means extracts a pseudo-density region, the image contracting means contracts the image using 
mutually different methods respectively in the pseudo-density region, the character/line drawing region and the region 
other than the pseudo-density region and the character/line drawing region, and the image outputting means outputs 
the contracted image. Using such an image processing apparatus, by dividing the input image into three regions, i.e., 
40 pseudo-density region, character/line drawing region and the other region, the image can be contracted with a moire 
being suppressed in the pseudo-density region, the image can be clearly contracted in the character/line drawing 
region, and the image can be properly contracted in the other region. 

[0267] In accordance with the eighteenth invention, the image contracting means contracts the image by a smooth- 
ing process in the pseudo-density region, contracts the image by an averaging process and a subsequent edge 

45 enhancing process in the character/line drawing region, and contracts the image by an averaging process in the other 
region, and the image outputting means outputs the contracted image. By such an image processing apparatus, the 
image can be contracted with a moire being suppressed in the pseudo-density region, the image can be clearly con- 
tracted in the character/line drawing region, and the image can be properly contracted in the other region. 
[0268] In accordance with the nineteenth invention, from the input image the character/line drawing region extract- 

50 ing means extracts a character/line drawing region, and thereafter the pseudo-density region extracting means extracts 
a pseudo-density region. By such an image processing apparatus, a character/line drawing region is firstly extract from 
the input image, and a pseudo-density region is then extracted. Therefore, the character/line drawing region can be 
accurately extracted without being affected from the pseudo-density region, even when it exists within the pseudo-den- 
sity region. 

55 [0269] In accordance with the twentieth invention, the character/line drawing region is extracted by the edge extrac- 
tion of the input image after the smoothing process thereof. By such an image processing apparatus, a character/line 
drawing region is firstly extract from the input image as mentioned above, and a pseudo-density region is then 
extracted. Therefore, the character/line drawing region can be accurately extracted without being affected from the 
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pseudo-density region, even when it exists within the pseudo-density region. 

[0270] In accordance with the twenty-first invention, the pseudo-density region is extracted by calculating the dis- 
persion of the peripheral pixels around each pixel of the input image and by extracting the pixel which is one of the pixels 
having a large dispersion and exists in the region which is not extracted as a character/line drawing region. Using such 
5 an image processing apparatus, by calculating the dispersion of peripheral pixels and by extracting, as a pseudo-den- 
sity region, the pixel is one of the pixels having a large dispersion and exists in the region which is not extracted as a 
character/line drawing region, the character/line drawing region is eliminated, whereby the pseudo-density region alone 
can be extracted accurately. 

[0271] In accordance with the twenty-second invention, the pseudo-density region is extracted by calculating the 
10 correlation of the peripheral pixels around each pixel of the input image and by extracting the pixel which is one of the 
pixels having a low correlation and exists in the region which is not extracted as a character/line drawing region. Using 
such an image processing apparatus, by calculating the correlation of peripheral pixels and by extracting, as a pseudo- 
density region, the pixel which is one of the pixels having a low correlation and exists in the region which is not extracted 
as a character/line drawing region, the character/line drawing region is eliminated more securely whereby the pseudo- 
15 density region alone can be extracted accurately. 

[0272] In accordance with the twenty-third invention, the pseudo-density region is extracted by detecting an edge 
region of the input image and by extracting the region which is one of the edge regions and is not extracted as a char- 
acter/line drawing region. By such an image processing apparatus, the edge filter is simple, and the pseudo-density 
region can be extracted fester. 

20 [0273] In accordance with the twenty-fourth invention, the edge detection is carried out in the pseudo-density 
region and the smoothing process is repeated for a region having a density greater than or equal to a predetermined 
value. By such an image processing apparatus, the image can be precisely contracted with a moire being suppressed 
more securely in the pseudo-density region. 

[0274] In accordance with the twenty-fifth invention, the edge detection is carried out in the pseudo-density region 
25 and the contracting process is interrupted for a region having a density greater than or equal to a predetermined value. 
By such an image processing apparatus, the normal contracting process can be continued with an unnecessary con- 
tracting process being avoided. 

[0275] In accordance with the twenty-sixth invention, an image is inputted, a character/line drawing region is 
extracted from the image, and a pseudo-density region is extracted, the image is contracted using mutually different 
30 methods respectively in the pseudo-density region, the character/line drawing region and the other region, and the 
image is then outputted. By such an image processing method, the image can be contracted with a moire being sup- 
pressed in the pseudo-density region, the image can be clearly contracted in the character/line drawing region, and the 
image can be properly contracted in the other region. 

[0276] In accordance with the twenty-seventh invention, a computer extracts a character/line drawing region from 

35 the image, extracts a pseudo-density region, contracts the image using mutually different methods respectively in the 
pseudo-density region, the character/line drawing region and the other region, and outputs it. Accordingly, a medium 
can be provided which records an image processing program such that the image is contracted with a moire being sup- 
pressed in the pseudo-density region, the image is clearly contracted in the character/line drawing region, and the 
image is properly contracted in the other region. 

40 [0277] In accordance with the twenty-eighth invention, front and back images are inputted from the image inputting 
means; after one of the images is reversed by the image reversing means, the positional relationship between the front 
and back images is detected by the positional relationship detecting means; and the image is corrected to be free from 
a ghost image by the image correcting means using the positional relationship, and then outputted by the image out- 
putting means. By such an image processing apparatus, the input image can be outputted without a ghost image. 

45 [0278] In accordance with the twenty-ninth invention, the positional relationship between the front and back images 
is detected by extracting the high brightness component alone of the front and back images and by performing the block 
matching of the high brightness component. By such an image processing apparatus, the positional relationship can be 
detected more precisely, and the input image can be outputted more securely without a ghost image. 
[0279] In accordance with the thirtieth invention, the image inputting means inputs an image, the edge detecting 

so means detects an edge of the image, the image correcting means corrects the image to eliminate a ghost image of the 
image by raising the brightness of high brightness pixels other than the edge of the image outputted from the edge 
detecting means, and the image outputting means outputs the image. By such an image processing apparatus, the 
input image can be outputted with the unclearness of a character being prevented and without a ghost image. 
[0280] In accordance with the thirty-first invention, the image inputting means inputs an image, the edge detecting 

55 means detects an edge of the image, the image dividing means divides the image based on the edge and low bright- 
ness pixels of the image outputted from the edge detecting means, the image correcting means corrects the image to 
eliminate a ghost image of the image by calculating the average brightness within a divided region and by raising the 
brightness of the high brightness region alone, and the image outputting means outputs the image. By such an image 
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processing apparatus, the input image can be outputted with the whitening-out of a halftone section being prevented 
and without a ghost image. 

[0281] In accordance with the thirty-second invention, the image in a high brightness region is corrected by obtain- 
ing the representative brightness from the pixels having a brightness within a predetermined range and by raising the 
5 brightness of the region with the referencing to the representative brightness. By such an image processing apparatus, 
the input image can be outputted without a ghost image, free from the influence of the difference in the transmittance 
depending on the paper quality. 

[0282] In accordance with the thirty-third invention, front and back images are inputted, after one of the images is 
reversed, the positional relationship between the front and back images is detected, and the image is corrected to be 
w free from a ghost image using the positional relationship, and then outputted. By such an image processing method, 
the input image can be outputted without a ghost image. 

[0283] In accordance with the thirty-fourth invention, an image is inputted, and an edge of the image is detected, 
and the image is corrected to be free from a ghost image of the image by raising the brightness of high brightness pixels 
other than the edge of the image outputted from the edge detection, and then outputted. By such an image processing 
15 method, the input image can be outputted with the unclearness of a character being prevented and without a ghost 
image. 

[0284] In accordance with the thirty-fifth invention, an image is inputted, and an edge of the image is detected, the 
image is divided based on the edge and the low brightness pixels of the image outputted from the edge detection, and 
the image is corrected to be free from a ghost image of the image by calculating the average brightness within a divided 
20 region and by raising the brightness of the high brightness region alone, and then outputted. By such an image process- 
ing method, the input image can be outputted with the whitening-out of a halftone section being prevented and without 
a ghost image. 

[0285] In accordance with the thirty-sixth invention, a computer reverses one of inputted front and back images, 
after that, detects the positional relationship between the front and back images, corrects the image to eliminate a ghost 
25 image using the positional relationship, and outputs it Accordingly, a medium can be provided which records an image 
processing program such that the input image is outputted without a ghost image. 

[0286] In accordance with the thirty-seventh invention, a computer detects an edge of an inputted image, corrects 
the image to eliminate a ghost image of the image by raising the brightness of high brightness pixels other than the 
edge of the image outputted from the edge detection, and outputs it. Accordingly, a medium can be provided which 
30 records an image processing program such that the input image is outputted with the unclearness of a character being 
prevented and without a ghost image. 

[0287] In accordance with the thirty-eighth invention, a computer detects an edge of an inputted image, divides the 
image based on the edge and the low brightness pixels of the image outputted from the edge detection, corrects the 
image to eliminate a ghost image of the image by calculating the average brightness within a divided region and by rais- 
35 ing the brightness of the high brightness region alone, and outputs it. Accordingly, a medium can be provided which 
records an image processing program such that the input image is outputted with the whitening-out of a halftone section 
being prevented and without a ghost image. 

[0288] In accordance with the thirty-ninth invention, the image inputting means inputs an image page by page. The 
image determining means determines a predetermined image from among the images. The template acquiring means 
40 acquires a template from the determined image. The image correcting means corrects the position between the images 
based on the template, thereby aligning the images of consecutive pages. By such an image processing apparatus, the 
alignment between desired consecutive images from among the images inputted page by page can be carried out in a 
short time. 

[0289] In accordance with the fortieth invention, the image inputting means inputs an image page by page of a 
45 book, the image determining means determines a predetermined main-text image from among the images, the tem- 
plate acquiring means acquires a template from the determined image, and the image correcting means corrects the 
position between main-text images based on the template, thereby aligning the main-text images of consecutive pages. 
By such an image processing apparatus, the alignment between main-text images from among the main-text images 
inputted page by page can be carried out in a short time. Thus, the contents of an electronic book can be prepared in 
so a short term. Further, since the position of the main-text images is aligned when the electronic book is viewed in a 
viewer, uncomfortableness to a user can be eliminated. 

[0290] In accordance with the forty-first invention, a predetermined image is determined from among the images 
inputted page by page, a template is acquired from the determined image, and the position between the images is cor- 
rected based on the template, thereby aligning the images of consecutive pages. By such an image processing method, 
55 the alignment between desired consecutive images from among the images inputted page by page can be carried out 
in a short time. 

[0291] In accordance with the forty-second invention, the template is acquired as the positional information of the 
rectangle defined by the circumscribing lines obtained from the ensemble of the edge points acquired by scanning the 
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input image. By such an image processing method, since the template is acquired using the circumscribing lines, an 
accurate template can be obtained, thereby improving the precision of the alignment. 

[0292] In accordance with the forty-third invention, a predetermined image is determined from among the input 
images, and warning data is generated in the case where the positional information of the input image and the posi- 
5 tional information of the template are out of a predetermined range. By such an image processing method, failure in the 
alignment between the images can be detected, and hence, there is convenience in revision during or after the author- 
ing. 

[0293] In accordance with the forty-fourth invention, a predetermined main-text image is determined from among 
the images inputted page by page of a book, a template is acquired from the determined image, and the position 

10 between main-text images is corrected based on the template, thereby aligning the main-text images of consecutive 
pages. By such an image processing method, the alignment between main-text images from among the main-text 
images inputted page by page can be carried out in a short time. Thus, the contents of an electronic book can be pre- 
pared in a short term. Further, since the position of the main-text images is aligned when the electronic book is viewed 
in a viewer, uncomfortableness to a user can be eliminated. 

15 [0294] In accordance with the forty-fifth invention, a computer determines a predetermined image from among the 
images inputted page by page, acquires a template from the determined image, and corrects the position between the 
images based on the template, thereby aligning the images of the consecutive pages. Accordingly, a medium can be 
provided which records an image processing program such that the alignment between desired consecutive images 
from among the images inputted page by page is carried out in a short time. 

20 [0295] In accordance with the forty-sixth invention, a computer determines a predetermined main-text image from 
among the images inputted page by page of a book, acquires a template from the determined image, and corrects the 
position between main-text images based on the template, thereby aligning the main-text images of consecutive pages. 
Accordingly, a medium can be provided which records an image processing program such that the alignment between 
main-text images from among the main-text images inputted page by page is carried out in a short time. 

25 

Claims 

1. An image processing apparatus comprising: 

30 image inputting means; 

color analyzing means for analyzing a color used within an input image; 

mixing-ratio calculating means for calculating a mixing-ratio of color components based on an analyzed color; 
and 

converting means for converting the input image to a monochromatic image by mixing color components 
35 according to a calculated mixing-ratio. 

2. The image processing apparatus of claim 1 , wherein the image inputting means is capable of inputting a plurality 
of images; 

40 the color analyzing means analyzes colors used within the plurality of input images; 

the mixing-ratio calculating means calculates mixing-ratios of color components which are common to the plu- 
rality of images, based on analyzed colors; and 

the converting means converts the plurality of input images to monochromatic images by mixing color compo- 
nents according to calculated mixing-ratios. 

45 

3. An image processing apparatus comprising: 

image inputting means; 

color specifying means for externally specifying a color used within an input image; 
so mixing-ratio calculating means for calculating a mixing-ratio of color components based on a specified color; 

and 

converting means for converting the input image to a monochromatic image by mixing color components 
according to a calculated mixing-ratio. 

55 4. An image processing apparatus comprising: 

image inputting means; 

mixing-ratio specifying means for externally specifying a mixing-ratio of color components; and 
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converting means for converting an input image to a monochromatic image by mixing color components 
according to a specified mixing-ratio. 

5. An image processing method comprising: 

5 

a color analyzing step of analyzing a color used within an input image; 

a mixing-ratio calculating step of calculating a mixing-ratio of color components based on an analyzed color; 
and 

a converting step of converting the input image to a monochromatic image by mixing color components accord- 
to ing to a calculated mixing-ratio. 

6. The image processing method of claim 5, wherein in the color analyzing step color analysis is carried out based on 
distribution of hue, saturation and lightness of the input image. 

15 7. An image processing method comprising: 

a color analyzing step of analyzing colors used within a plurality of input images; 

a mixing-ratio calculating step of calculating mixing-ratios of color components which are common to the plu- 
rality of input images, based on analyzed colors; and 
20 a converting step of converting the plurality of input images to monochromatic images by mixing color compo- 

nents according to calculated mixing-ratios. 

8. An image processing method comprising: 

25 a color specifying step of externally specifying a color used within an input image; 

a mixing-ratio calculating step of calculating a mixing-ratio of color components based on a specified color; and 
a converting step of converting the input image to a monochromatic image by mixing color components accord- 
ing to a calculated mixing-ratio. 

30 9. The image processing method of any one of claims 5, 6 and 8, wherein in the mixing-ratio calculating step a mixing- 
ratio is calculated based on a mixing-ratio table in which a mixing-ratio of color components corresponding to the 
color used within the input image is previously stored. 

10. The image processing method of any one of claims 5, 6 and 8, wherein in the mixing-ratio calculating step the mix- 
35 ing-ratio is calculated based on a ratio of color components of a complimentary color of the color used within the 
input image. 

11 The image processing method of any one of claims 5, 6 and 8, wherein in the mixing-ratio calculating step the mix- 
ing-ratio is calculated based on a color component ratio of a complimentary color of the color used within the input 
40 image and the color component ratio of the colors used within the input image. 

12. An image processing method comprising: 

a mixing-ratio specifying step of externally specifying a mixing-ratio of color components of an input image; and 
45 a converting step of converting the input image to a monochromatic image by mixing color components accord- 

ing to a specified mixing-ratio. 

13. An medium on which an image processing program is recorded, the image processing program being for causing 
a computer to execute a color analyzing step of analyzing a color used within an input image; a mixing-ratio calcu- 

50 lating step of calculating a mixing-ratio of color components based on a analyzed color; and a converting step of 
converting the input image to a monochromatic image by mixing color components according to a calculated mix- 
ing-ratio. 

14. An medium on which an image processing program is recorded, the image processing program being for causing 
55 a computer to execute a color analyzing step of analyzing colors used within a plurality of input images; a mixing- 
ratio calculating step of calculating mixing-ratios of color components which are common to the plurality of input 
images, based on analyzed colors; and a converting step of converting the plurality of input images to monochro- 
matic images by mixing color components according to calculated mixing-ratios. 
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15. An medium on which an image processing program is recorded, the image processing program being for causing 
a computer to execute a color specifying step of externally specifying a color used within an input image; a mixing- 
ratio calculating step of calculating a mixing-ratio of color components based on a specified color; and a converting 
step of converting the input image to a monochromatic image by mixing color components according to a calcu- 
lated mixing-ratio. 

16. An medium on which an image processing program is recorded, the image processing program being for causing 
a computer to execute a mixing-ratio specifying step of externally specifying a mixing-ratio of color components of 
an input image; and a converting step of converting the input image to a monochromatic image by mixing color 
components according to a specified mixing-ratio. 

17. An image processing apparatus comprising: 

image inputting means for inputting an image; 

character/line drawing region extracting means for extracting a character/line drawing region from the input 
image; 

pseudo-density region extracting means for extracting a pseudo-density region from the input image; 
image contracting means for contracting images in an extracted pseudo-density region, an extracted charac- 
ter/line drawing region, and a region other than the pseudo-density region and the character/line drawing 
region, by mutually different methods; and 
image outputting means for outputting the contracted image. 

18. The image processing apparatus of claim 17, wherein the image contracting means performs a smoothing process 
in the pseudo-density region, performs an averaging process and a subsequent edge enhancing process in the 
character/line drawing region, and performs an averaging process in a region other than the pseudo-density region 
and the character/line drawing region. 

19. The image processing apparatus of claim 17, wherein the character/line drawing region extracting means extracts 
a character/line drawing region from the input image before the extraction of a pseudo-density region. 

20. The image processing apparatus of claim 19, wherein the character/line drawing region extracting means extracts 
a character/line drawing region by performing an edge extraction of the input image after performing a smoothing 
process thereof 

21 . The image processing apparatus of any one of claims 17,19 and 20, wherein the pseudo-density region extracting 
means calculates a dispersion of peripheral pixels around each pixel of the input image and extracts, as a pseudo- 
density region, the pixel which is one of pixels having a large dispersion and exists in a region which is not extracted 
as a character/line drawing region by the character/line drawing region extracting means. 

22. The image processing apparatus of any one of claims 1 7, 1 9 and 20, wherein the pseudo-density region extracting 
means calculates a correlation of peripheral pixels around each pixel of the input image and extracts, as a pseudo- 
density region, a pixel which is one of pixels having a low correlation and exists in the region which is not extracted 
as a character/line drawing region by the character/line drawing region extracting means. 

23. The image processing apparatus of any one of claims 1 7, 1 9 and 20, wherein the pseudo-density region extracting 
means detects an edge region of the input image and extracts, as a pseudo-density region, a region which is one 
of the extracted edge regions and is not extracted as a character/line drawing region by the character/line drawing 
region extracting means. 

24. The image processing apparatus of claim 18, wherein the contracting means performs edge detection of an 
extracted pseudo-density region and repeats the smoothing process for a region having a density greater than or 
equal to a predetermined value. 

25. The image processing apparatus of claim 1 7, wherein the image contracting means performs edge detection of the 
extracted pseudo-density region and interrupts a contracting process for a region having a density greater than or 
equal to a predetermined value. 

26. An image processing method comprising: 
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an image inputting step; 

a character/line drawing region extracting step of extracting a character/line drawing region from an input 
image; 

a pseudo-density region extracting step of extracting a pseudo-density region from the input image; 
5 a image contracting step of contracting the image using mutually different methods respectively in the 

extracted pseudo-density region, the extracted character/line drawing region and the region other than the 
pseudo-density region and the character/line drawing region; and 
an image outputting step of outputting an contracted image. 

w 27. An medium recording an image processing program for causing a computer to execute an image inputting step; a 
character/line drawing region extracting step of extracting a character/line drawing region from an input image; a 
pseudo-density region extracting step of extracting a pseudo-density region from the input image; an image con- 
tracting step of contracting the image using mutually different methods respectively in the extracted pseudo-density 
region, the extracted character/line drawing region and the region other than the pseudo-density region and the 

15 character/line drawing region; and an image outputting step of outputting a contracted image. 

28. An image processing apparatus comprising: 

image inputting means for inputting front and back images of an original; 
20 image reversing means for reversing one of the front and back images; 

positional relationship detecting means for detecting the positional relationship between the front image 
reversed by the image reversing means and the back image from the image inputting means or the positional 
relationship between the back image reversed by the image reversing means and the front image from the 
image inputting means; 

25 image correcting means for correcting the image to eliminate a ghost image of the image using the positional 

relationship between the front and back images obtained from the positional relationship detecting means; and 
image outputting means for outputting the image. 

29. The image processing apparatus of claim 28, wherein the positional relationship detecting means detects the posi- 
30 tional relationship between the front and back images by extracting the high brightness component alone of the 

front and back images and by performing the block matching of the high brightness component. 

30. An image processing apparatus comprising: 

35 image inputting means; 

edge detecting means for detecting an edge of the image form the image inputting means; 
image correcting means for correcting the image to eliminate a ghost image of the image by raising the bright- 
ness of high brightness pixels other than the edge of the image outputted from the edge detecting means; and 
image outputting means for outputting the image. 

40 

31. An image processing apparatus comprising: 

image inputting means; 

edge detecting means for detecting an edge of the image form the image inputting means; 
45 image dividing means for dividing the image depending on the edge and low brightness pixels of the image out- 

putted from the edge detecting means; 

image correcting means for correcting the image to eliminate a ghost image of the image by calculating the 
average brightness within a region divided by the image dividing means and by raising the brightness of the 
high brightness region alone; and 
so image outputting means for outputting the image. 

32. The image processing apparatus of claim 31, wherein the image correcting means acquires an representative 
brightness from the pixels having a brightness within a predetermined range, thereby raising the brightness of the 
region with referencing to the representative brightness. 

55 

33. An image processing method comprising: 

an image reversing step of reversing one of front and back images of an original; 
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a positional relationship detecting step of detecting a positional relationship between the reversed one and the 
other of the front and back images; and 

an image correcting step of correcting the other one to eliminate a ghost image of the reversed one using a 
result of the positional relationship detection. 

5 

34. An image processing method comprising: 

an image-edge detecting step of detecting an edge of an image; and 

an image correcting step of correcting the image to eliminate a ghost image from the image by raising the 
10 brightness of high brightness pixels other than a detected edge. 

35. An image processing method comprising: 

an image-edge detecting step of detecting an edge of an image; 
15 an image dividing step of dividing the image based on a detected edge and low brightness pixels; and 

an image correcting step of correcting the image to eliminate a ghost image from the image by calculating an 
average brightness within a divided region and by raising a brightness of the high brightness region alone. 

36. An medium on which an image processing program is recorded, the image processing program being for causing 
20 a computer to execute an image reversing step of reversing one of front and back images; a positional relationship 

detecting step of detecting a positional relationship between the reversed one and the other of the front and back 
images; and an image correcting step of correcting the image to eliminate a ghost image from the other using a 
result of the positional relationship detection. 

25 37. An medium on which an image processing program is recorded, the image processing program being for causing 
a computer to execute an image-edge detecting step of detecting an edge of an image; and an image correcting 
step of correcting the image to eliminate a ghost image of the image by raising a brightness of a high brightness 
pixel other than the detected edge. 

30 38. An medium on which an image processing program is recorded, the image processing program being for causing 
a computer to execute an image-edge detecting step of detecting an edge of an image; an image dividing step of 
dividing the image based on a detected edge and low brightness pixels; and an image correcting step of correcting 
the image to eliminate a ghost image from the image by calculating an average brightness within a divided region 
and by raising a brightness of a high brightness region alone. 

35 

39. An image processing apparatus comprising: 

image inputting means for inputting an image page by page; 

image determining means for determining a predetermined image from among inputted images; 
40 template acquiring means for acquiring a template used as an alignment reference from an image which is 

determined as the predetermined image; and 

image correcting means for correcting a position between the images based on the template, thereby aligning 
images of consecutive pages. 

45 40. An image processing apparatus comprising: 

image inputting means for inputting an image page by page of a book; 

image determining means for determining a predetermined main-text image from among inputted images; 
template acquiring means for acquiring a template used as an alignment reference from an image which is 
so determined as the predetermined main-text image; and 

image correcting means for correcting a position between the main-text images based on the template, thereby 
aligning the main-text images of consecutive pages. 

41. An image processing method comprising: 

55 

an image determining step of determining a predetermined image from among images inputted page by page; 
a template acquiring step of acquiring a template used as an alignment reference from an image which is 
determined as the predetermined image; and 
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an image correcting means for correcting a position between the images based on the template, thereby align- 
ing images of consecutive pages. 

42. The image processing method of claim 41, wherein the template acquiring step is a step of acquiring, as a terrv 
5 plate, positional information of a rectangle defined by circumscribing lines obtained from an ensemble of edge 

points acquired by scanning the input image. 

43. The image processing method of claim 42, wherein the image processing method further comprises a step of gen- 
erating warning data in the case where the predetermined image is determined from among input images during 

w the image determining step and that positional information of the input image and positional information of the tem- 
plate are out of a predetermined range. 

44. An image processing method comprising: 

15 an image determining step of determining a predetermined main-text image from among images inputted page 

by page of a book; 

a template acquiring step of acquiring a template used as an alignment reference from an image which is 
determined as the predetermined main-text image; and 

an image correcting step of correcting a position between the main-text images based on the template, thereby 
20 aligning main-text images of consecutive pages. 

45. An medium on which an image processing program is recorded, the image processing program being for causing 
a computer to execute an image determining step of deter mining a predetermined image from among images 
inputted page by page; a template acquiring step of acquiring a template used as an alignment reference from an 

25 image which is determined as the predetermined image; and image correcting means for correcting a position 
between images based on the template, thereby aligning images of consecutive pages. 

46. An medium on which an image processing program is recorded, the image processing program being for causing 
a computer to execute an image determining step of determining a predetermined main-text image from among 

30 images inputted page by page of a book; template acquiring step of acquiring a template used as an alignment ref- 
erence from an image which is determined as the predetermined main-text image; and image correcting step of 
correcting a position between the main-text images based on the template, thereby aligning main-text images of 
consecutive pages. 
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